Apr 02 19:49:40 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:49:40 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:49:40 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO dbcounter [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Registered counter for database cinder Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG dbcounter [-] [72689] Writer thread running {{(pid=72689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.rpc [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.rpc [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Determined volume DB was empty at startup. Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG cinder.volume.manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72689) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING stevedore.named [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING castellan.key_manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING cinder.keymgr.conf_key_mgr [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG cinder.volume.drivers.lvm [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72689) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_concurrency.processutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72689) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_concurrency.processutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] CMD "cinder-rtstool verify" returned: 0 in 0.230s {{(pid=72689) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.rpc [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.rpc [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING stevedore.named [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING castellan.key_manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:49:41 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:49:41 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Starting 1 workers Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Started child 72792 {{(pid=72689) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Full set of CONF: {{(pid=72689) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] ******************************************************************************** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Configuration options gathered from: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] ================================================================================ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] allow_availability_zone_fallback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] allow_compression_on_image_upload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] allowed_direct_url_schemes = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] api_rate_limit = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] auth_strategy = keystone {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] az_cache_duration = 3600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_host = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_stats_polling_interval = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backup_api_class = cinder.backup.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backup_name_template = backup-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backup_use_same_host = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backup_use_temp_snapshot = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] chap_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_internal_tenant_project_id = 10ba0d8ed5ed4e968a6973c2ea3779d6 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_internal_tenant_user_id = a1580f00b78948d2abe34c2e0e5ae444 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cloned_volume_same_az = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cluster = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] compression_format = gzip {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] compute_api_class = cinder.compute.nova.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] config_dir = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] config_source = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] control_exchange = openstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] debug = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] default_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] default_group_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72792]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] default_volume_type = lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_ssl_cert_verify = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] driver_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] enable_force_upload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] enable_new_services = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] enable_unsupported_driver = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] enforce_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_api_insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_api_servers = ['http://192.168.122.233/image'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_api_ssl_compression = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_ca_certificates_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_catalog_info = image:glance:publicURL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_num_retries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance_request_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] graceful_shutdown_timeout = 5 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] group_api_class = cinder.group.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] host = devstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_compress_on_upload = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_conversion_address_space_limit = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_conversion_cpu_limit = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_conversion_disable = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_upload_use_cinder_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_upload_use_internal_tenant = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_volume_cache_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_volume_cache_max_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] image_volume_cache_max_size_gb = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] init_host_max_objects_retrieval = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] instance_format = [instance: %(uuid)s] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iscsi_target_flags = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iscsi_write_cache = on {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iser_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iser_ip_address = 192.168.122.233 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iser_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_color = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_config_append = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_options = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_rotate_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_rotate_interval_type = days {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] log_rotation_type = none {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] max_age = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] max_logfile_count = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] max_logfile_size_mb = 200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] max_over_subscription_ratio = 20.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] message_reap_interval = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] message_ttl = 2592000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] migration_create_volume_timeout_secs = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] monkey_patch = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] monkey_patch_modules = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] my_ip = 192.168.122.233 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] no_snapshot_gb_quota = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] num_iser_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] num_shell_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] num_volume_device_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] nvmeof_conn_info_version = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] nvmet_ns_id = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] nvmet_port_id = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_max_limit = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_ext_list = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_listen_port = 8776 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] osapi_volume_workers = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] per_volume_size_limit = -1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] periodic_fuzzy_delay = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] periodic_interval = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] public_endpoint = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] publish_errors = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_backup_gigabytes = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_backups = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_gigabytes = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_groups = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_snapshots = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] quota_volumes = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] rate_limit_burst = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] rate_limit_except_level = CRITICAL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] rate_limit_interval = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] reinit_driver_count = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] report_discard_supported = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] report_interval = 120 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] reservation_clean_interval = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] reservation_expire = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] reserved_image_namespaces = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] reserved_percentage = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] rpc_response_timeout = 120 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] run_external_periodic_tasks = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] scst_target_driver = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_down_time = 720 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] shell_completion = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] snapshot_name_template = snapshot-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] snapshot_same_host = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] state_path = /opt/stack/data/cinder {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] storage_availability_zone = nova {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] storage_protocol = iSCSI {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] syslog_log_facility = LOG_USER {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_helper = lioadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_ip_address = 192.168.122.233 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] target_secondary_ip_addresses = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] transport_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] until_refresh = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_chap_auth = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_default_quota_class = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_journal = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_json = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_stderr = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] use_syslog = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] verify_glance_signatures = enabled {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_api_class = cinder.volume.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_clear_size = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_copy_bps_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_dd_blocksize = 1M {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_name_template = volume-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_service_inithost_offload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volume_usage_audit_period = month {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] zoning_mode = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_concurrency.disable_process_locking = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.admin_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.admin_token = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.admin_user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_port = 35357 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_protocol = https {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_uri = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.auth_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.cache = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.identity_uri = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.include_service_catalog = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.interface = public {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_password = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcache_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.service_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.backend = dogpile.cache.null {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.backend_argument = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.backend_expiration_time = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.config_prefix = cache.oslo {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.debug_cache_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.enable_retry_client = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.enable_socket_keepalive = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.enforce_fips_mode = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.expiration_time = 600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.hashclient_retry_attempts = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_dead_retry = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_pool_maxsize = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_sasl_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.proxies = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.redis_db = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.redis_server = localhost:6379 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.retry_attempts = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.retry_delay = 0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.socket_keepalive_count = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.socket_keepalive_idle = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.socket_keepalive_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.socket_timeout = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.tls_allowed_ciphers = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.tls_cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.tls_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.tls_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.tls_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cache.username = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] coordination.backend_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.asyncio_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.asyncio_slave_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.backend = sqlalchemy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.connection_debug = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.connection_parameters = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.connection_recycle_time = 3600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.connection_trace = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.db_inc_retry_interval = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.db_max_retries = 20 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.db_max_retry_interval = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.db_retry_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.max_overflow = 50 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.max_pool_size = 5 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.max_retries = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.mysql_wsrep_sync_wait = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.pool_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.retry_interval = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.slave_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.sqlite_synchronous = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.synchronous_reader = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] database.use_db_reconnect = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.connection_string = messaging:// {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.es_doc_type = notification {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.es_scroll_size = 10000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.es_scroll_time = 2m {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.filter_error_trace = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.hmac_keys = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.sentinel_service_name = mymaster {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.socket_timeout = 0.1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.trace_requests = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler.trace_sqlalchemy = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler_jaeger.process_tags = {} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler_jaeger.service_name_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] profiler_otlp.service_name_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.enforce_new_defaults = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: WARNING oslo_config.cfg [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.enforce_scope = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.policy_default_rule = default {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.policy_file = policy.yaml {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.group = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.helper_command = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] privsep_osbrick.user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72792]: INFO cinder.volume.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.group = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.helper_command = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] cinder_sys_admin.user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.send_service_user_token = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] service_user.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] glance.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.chap_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.driver_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.extra_capabilities = {} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iscsi_target_flags = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iscsi_write_cache = on {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iser_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iser_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.lvm_share_target = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.lvm_type = auto {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.num_shell_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.report_discard_supported = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.reserved_percentage = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.unique_fqdn_network = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.use_chap_auth = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_clear_size = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_reports.file_event_handler = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_reports.log_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.backend_host = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.chap_username = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.extra_capabilities = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iser_helper = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iser_ip_address = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iser_port = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.lvm_share_target = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.lvm_type = auto {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.num_shell_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.report_discard_supported = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.reserved_percentage = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.scst_target_driver = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.storage_protocol = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_helper = lioadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_ip_address = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.use_chap_auth = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_clear_size = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] lvmdriver-1.volumes_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_notifications.driver = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_notifications.retry = -1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] key_manager.fixed_key = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.barbican_api_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.barbican_endpoint = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.barbican_endpoint_type = public {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.barbican_region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.number_of_retries = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.retry_delay = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.send_service_user_token = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.verify_ssl = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican.verify_ssl_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.auth_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] barbican_service_user.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.approle_role_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.approle_secret_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.kv_mountpoint = secret {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.kv_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.kv_version = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.root_token_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.ssl_ca_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:49:41 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] ******************************************************************************** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:41 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:42 devstack sudo[72804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 02 19:49:42 devstack sudo[72804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:42 devstack sudo[72804]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:42 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:42 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:42 devstack sudo[72985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:42 devstack sudo[72985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:42 devstack sudo[72985]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:42 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.472s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:42 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:49:42 devstack cinder-volume[72792]: INFO cinder.brick.local_dev.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 02 19:49:42 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:43 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:43 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:43 devstack sudo[73185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:43 devstack sudo[73185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:43 devstack sudo[73185]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:43 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.564s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:43 devstack cinder-volume[72792]: DEBUG cinder.brick.local_dev.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72792) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 02 19:49:43 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:43 devstack sudo[73319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:43 devstack sudo[73319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:44 devstack sudo[73319]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:44 devstack sudo[73456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:44 devstack sudo[73456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:44 devstack sudo[73456]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:44 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:44 devstack sudo[73492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 02 19:49:44 devstack sudo[73492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:45 devstack sudo[73492]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:45 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.424s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:45 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:45 devstack sudo[73495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:45 devstack sudo[73495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:45 devstack sudo[73495]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:45 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:45 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:45 devstack sudo[73500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:45 devstack sudo[73500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:46 devstack sudo[73500]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:46 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:46 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:46 devstack sudo[73507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:46 devstack sudo[73507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:46 devstack sudo[73507]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:46 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:46 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:46 devstack sudo[73512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:46 devstack sudo[73512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:47 devstack sudo[73512]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:47 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:47 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:47 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:47 devstack cinder-volume[72792]: INFO cinder.volume.drivers.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:47 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:47 devstack sudo[73526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:47 devstack sudo[73526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:48 devstack sudo[73526]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:48 devstack sudo[73641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:48 devstack sudo[73641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:48 devstack sudo[73641]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:48 devstack sudo[73693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:48 devstack sudo[73693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:48 devstack sudo[73693]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:48 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:49 devstack sudo[73783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:49 devstack sudo[73783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:49 devstack sudo[73783]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:49 devstack sudo[73786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:49 devstack sudo[73786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:49 devstack sudo[73786]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:49 devstack cinder-volume[72792]: INFO cinder.volume.driver [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Driver hasn't implemented _init_vendor_properties() Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG cinder.volume.driver [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72792) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG oslo_db.sqlalchemy.engines [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG dbcounter [-] [72792] Writer thread running {{(pid=72792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG cinder.db.sqlalchemy.api [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Building query based on filter {{(pid=72792) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG cinder.image.image_utils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72792) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 19:49:49 devstack cinder-volume[72792]: INFO cinder.keymgr.migration [None req-f0cde210-230d-43dd-8d3e-dae2762d507a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:49:49 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:49 devstack sudo[73794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:49 devstack sudo[73794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:50 devstack sudo[73794]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:50 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:50 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:50 devstack sudo[73798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:50 devstack sudo[73798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:50 devstack sudo[73798]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:50 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:50 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:50 devstack sudo[73801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:50 devstack sudo[73801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:51 devstack sudo[73801]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:51 devstack sudo[73807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:51 devstack sudo[73807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:51 devstack sudo[73807]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG cinder.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Notifying Schedulers of capabilities ... {{(pid=72792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:49:51 devstack cinder-volume[72792]: INFO cinder.volume.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Driver initialization completed successfully. Apr 02 19:49:51 devstack cinder-volume[72792]: INFO cinder.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Initiating service 2 cleanup Apr 02 19:49:51 devstack cinder-volume[72792]: INFO cinder.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Service 2 cleanup completed. Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG cinder.service [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Creating RPC server for service cinder-volume {{(pid=72792) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG cinder.service [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72792) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 19:49:51 devstack cinder-volume[72689]: DEBUG dbcounter [-] [72689] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:49:51 devstack cinder-volume[72792]: INFO cinder.volume.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:49:51 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:51 devstack sudo[73816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:49:51 devstack sudo[73816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:52 devstack sudo[73816]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:52 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:52 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:52 devstack sudo[73820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:52 devstack sudo[73820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:52 devstack sudo[73820]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:52 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:52 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:52 devstack sudo[73877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:49:52 devstack sudo[73877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:53 devstack sudo[73877]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:53 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:53 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:49:53 devstack sudo[73880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:49:53 devstack sudo[73880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:49:53 devstack sudo[73880]: pam_unix(sudo:session): session closed for user root Apr 02 19:49:53 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:49:53 devstack cinder-volume[72792]: INFO cinder.volume.manager [None req-fdfed2aa-a2c3-487c-a614-c3b6270d600b None None] Driver post RPC initialization completed successfully. Apr 02 19:50:01 devstack cinder-volume[72792]: DEBUG dbcounter [-] [72792] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:50:03 devstack cinder-volume[72792]: DEBUG dbcounter [-] [72792] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:51:04 devstack cinder-volume[72792]: DEBUG oslo_service.periodic_task [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72792) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:51:04 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:51:04 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:51:04 devstack sudo[78634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:51:04 devstack sudo[78634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:51:05 devstack sudo[78634]: pam_unix(sudo:session): session closed for user root Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:51:05 devstack sudo[78646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:51:05 devstack sudo[78646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:51:05 devstack sudo[78646]: pam_unix(sudo:session): session closed for user root Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:51:05 devstack sudo[78649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:51:05 devstack sudo[78649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:51:05 devstack sudo[78649]: pam_unix(sudo:session): session closed for user root Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.413s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:51:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:51:05 devstack sudo[78658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:51:05 devstack sudo[78658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:51:06 devstack sudo[78658]: pam_unix(sudo:session): session closed for user root Apr 02 19:51:06 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:51:06 devstack cinder-volume[72792]: DEBUG cinder.manager [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Notifying Schedulers of capabilities ... {{(pid=72792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:52:03 devstack cinder-volume[72792]: DEBUG dbcounter [-] [72792] Writing DB stats cinder:SELECT=1 {{(pid=72792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:52:03 devstack cinder-volume[72792]: DEBUG dbcounter [-] [72792] Writing DB stats cinder:UPDATE=1 {{(pid=72792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:52:04 devstack cinder-volume[72792]: DEBUG oslo_service.periodic_task [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72792) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:52:04 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:52:04 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:52:04 devstack sudo[80436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:52:04 devstack sudo[80436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:52:05 devstack sudo[80436]: pam_unix(sudo:session): session closed for user root Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:52:05 devstack sudo[80460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:52:05 devstack sudo[80460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:52:05 devstack sudo[80460]: pam_unix(sudo:session): session closed for user root Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:52:05 devstack sudo[80474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:52:05 devstack sudo[80474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:52:05 devstack sudo[80474]: pam_unix(sudo:session): session closed for user root Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:52:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:52:05 devstack sudo[80498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:52:05 devstack sudo[80498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:52:06 devstack sudo[80498]: pam_unix(sudo:session): session closed for user root Apr 02 19:52:06 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:52:06 devstack cinder-volume[72792]: DEBUG cinder.manager [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Notifying Schedulers of capabilities ... {{(pid=72792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:53:04 devstack cinder-volume[72792]: DEBUG oslo_service.periodic_task [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72792) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:53:04 devstack cinder-volume[72792]: DEBUG cinder.volume.drivers.lvm [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Updating volume stats {{(pid=72792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 19:53:04 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:04 devstack sudo[81668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 19:53:04 devstack sudo[81668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:05 devstack sudo[81668]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:05 devstack sudo[81672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:53:05 devstack sudo[81672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:05 devstack sudo[81672]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:05 devstack sudo[81698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 19:53:05 devstack sudo[81698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:05 devstack sudo[81698]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.408s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:05 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:05 devstack sudo[81705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 19:53:05 devstack sudo[81705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:06 devstack sudo[81705]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:06 devstack cinder-volume[72792]: DEBUG oslo_concurrency.processutils [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=72792) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:06 devstack cinder-volume[72792]: DEBUG cinder.manager [None req-1122c4b1-fbe2-462a-8776-dfaa46e9e3c8 None None] Notifying Schedulers of capabilities ... {{(pid=72792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:53:14 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Caught SIGTERM, stopping children Apr 02 19:53:14 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Acquiring lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:14 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Acquired lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:14 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Releasing lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:14 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Stop services. {{(pid=72689) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 19:53:14 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Killing children. {{(pid=72689) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 19:53:14 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Waiting on 1 children to exit Apr 02 19:53:16 devstack cinder-volume[72792]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Acquiring lock "singleton_lock" {{(pid=72792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:16 devstack cinder-volume[72792]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Acquired lock "singleton_lock" {{(pid=72792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:16 devstack cinder-volume[72792]: DEBUG oslo_concurrency.lockutils [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Releasing lock "singleton_lock" {{(pid=72792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:16 devstack cinder-volume[72792]: WARNING amqp [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 19:53:16 devstack cinder-volume[72792]: WARNING amqp [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 19:53:16 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-9b1f3c6f-2a7b-4e31-b9a5-e89d7344b621 None None] Child 72792 exited with status 0 Apr 02 19:53:18 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:19 devstack cinder-volume[82017]: INFO dbcounter [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Registered counter for database cinder Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_db.sqlalchemy.engines [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG dbcounter [-] [82017] Writer thread running {{(pid=82017) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:53:19 devstack cinder-volume[82017]: INFO cinder.rpc [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 19:53:19 devstack cinder-volume[82017]: INFO cinder.rpc [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_db.sqlalchemy.engines [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:19 devstack cinder-volume[82017]: INFO cinder.volume.manager [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Determined volume DB was empty at startup. Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG cinder.volume.manager [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82017) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 19:53:19 devstack cinder-volume[82017]: INFO cinder.volume.manager [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 19:53:19 devstack cinder-volume[82017]: WARNING stevedore.named [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 19:53:19 devstack cinder-volume[82017]: WARNING castellan.key_manager [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:53:19 devstack cinder-volume[82017]: WARNING cinder.keymgr.conf_key_mgr [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:53:19 devstack cinder-volume[82017]: INFO cinder.volume.manager [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_db.sqlalchemy.engines [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82017) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:19 devstack cinder-volume[82017]: INFO oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Starting 1 workers Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Started child 82133 {{(pid=82017) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Full set of CONF: {{(pid=82017) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] ******************************************************************************** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Configuration options gathered from: {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] ================================================================================ {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] allow_availability_zone_fallback = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] allow_compression_on_image_upload = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82133]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] allowed_direct_url_schemes = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] api_rate_limit = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] auth_strategy = keystone {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_availability_zone = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_host = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_stats_polling_interval = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backup_api_class = cinder.backup.api.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backup_name_template = backup-%s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backup_use_same_host = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backup_use_temp_snapshot = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] chap_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] chap_username = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_internal_tenant_project_id = 10ba0d8ed5ed4e968a6973c2ea3779d6 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_internal_tenant_user_id = a1580f00b78948d2abe34c2e0e5ae444 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cluster = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] compression_format = gzip {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] compute_api_class = cinder.compute.nova.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] config_dir = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] config_source = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] control_exchange = openstack {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] debug = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] default_availability_zone = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] default_group_type = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] default_volume_type = QuobyteHD {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] disk_geometry = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82133]: INFO cinder.volume.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_client_cert = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_client_cert_key = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82133) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_data_namespace = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_ssl_cert_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_ssl_cert_verify = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] driver_use_ssl = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] enable_new_services = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] enable_unsupported_driver = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] enabled_backends = ['QuobyteHD'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] enforce_multipath_for_image_xfer = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] filter_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_api_insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_api_servers = ['http://192.168.122.233/image'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_api_ssl_compression = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_ca_certificates_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_catalog_info = image:glance:publicURL {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_num_retries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance_request_timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] goodness_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] graceful_shutdown_timeout = 5 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] group_api_class = cinder.group.api.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] host = devstack {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_compress_on_upload = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_conversion_address_space_limit = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_conversion_cpu_limit = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_conversion_disable = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_upload_use_cinder_backend = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_upload_use_internal_tenant = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_volume_cache_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_volume_cache_max_count = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] image_volume_cache_max_size_gb = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] init_host_max_objects_retrieval = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] instance_format = [instance: %(uuid)s] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iscsi_target_flags = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iscsi_write_cache = on {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iser_helper = tgtadm {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iser_ip_address = 192.168.122.233 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iser_port = 3260 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_color = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_config_append = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_dir = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_options = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_rotate_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_rotate_interval_type = days {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] log_rotation_type = none {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] max_age = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] max_logfile_count = 30 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] max_logfile_size_mb = 200 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] max_over_subscription_ratio = 20.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] message_reap_interval = 86400 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] message_ttl = 2592000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] migration_create_volume_timeout_secs = 300 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] monkey_patch = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] monkey_patch_modules = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] my_ip = 192.168.122.233 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] no_snapshot_gb_quota = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] num_iser_scan_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] num_shell_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] num_volume_device_scan_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] nvmeof_conn_info_version = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] nvmet_ns_id = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] nvmet_port_id = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_max_limit = 1000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_ext_list = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_listen_port = 8776 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_use_ssl = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] osapi_volume_workers = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] per_volume_size_limit = -1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] periodic_fuzzy_delay = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] periodic_interval = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] public_endpoint = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] publish_errors = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_backup_gigabytes = 1000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_backups = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_gigabytes = 1000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_groups = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_snapshots = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] quota_volumes = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] rate_limit_burst = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] rate_limit_except_level = CRITICAL {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] rate_limit_interval = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] reinit_driver_count = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] replication_device = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] report_discard_supported = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] report_interval = 120 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] reservation_clean_interval = 86400 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] reservation_expire = 86400 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] reserved_image_namespaces = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] reserved_percentage = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] rpc_response_timeout = 120 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] run_external_periodic_tasks = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] scst_target_driver = iscsi {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] scst_target_iqn_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_down_time = 720 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] shell_completion = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] snapshot_name_template = snapshot-%s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] split_loggers = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82133) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 19:53:19 devstack cinder-volume[82133]: WARNING cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 19:53:19 devstack cinder-volume[82133]: WARNING cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] state_path = /opt/stack/data/cinder {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] storage_availability_zone = nova {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] storage_protocol = iSCSI {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Running cmd (subprocess): mount.quobyte {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] syslog_log_facility = LOG_USER {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_helper = lioadm {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_ip_address = 192.168.122.233 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_port = 3260 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_protocol = iscsi {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] target_secondary_ip_addresses = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] trace_flags = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] transport_url = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] until_refresh = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_chap_auth = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_default_quota_class = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_journal = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_json = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_multipath_for_image_xfer = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_stderr = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] use_syslog = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] verify_glance_signatures = enabled {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_api_class = cinder.volume.api.API {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_backend_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_clear = zero {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_clear_ionice = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_clear_size = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_copy_bps_limit = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_dd_blocksize = 1M {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_name_template = volume-%s {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_service_inithost_offload = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volume_usage_audit_period = month {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] zoning_mode = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_concurrency.disable_process_locking = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.admin_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.admin_token = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.admin_user = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_port = 35357 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_protocol = https {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_section = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_type = password {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_uri = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.auth_version = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.cache = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.identity_uri = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.include_service_catalog = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.interface = public {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_password = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcache_username = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.region_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.service_type = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.backend = dogpile.cache.null {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.backend_argument = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.backend_expiration_time = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.config_prefix = cache.oslo {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.debug_cache_backend = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.enable_retry_client = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.enable_socket_keepalive = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.enforce_fips_mode = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.expiration_time = 600 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.hashclient_retry_attempts = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_dead_retry = 300 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_pool_maxsize = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_sasl_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.proxies = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.redis_db = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.redis_server = localhost:6379 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.retry_attempts = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.retry_delay = 0.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.socket_keepalive_count = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.socket_keepalive_idle = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.socket_keepalive_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.socket_timeout = 1.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.tls_allowed_ciphers = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.tls_cafile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.tls_certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.tls_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.tls_keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cache.username = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] coordination.backend_url = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.asyncio_connection = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.asyncio_slave_connection = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.backend = sqlalchemy {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.connection = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack quobyte-client[82137]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 19:53:19 devstack quobyte-client[82137]: Invalid parameters found, error: missing mount point. Apr 02 19:53:19 devstack quobyte-client[82137]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 19:53:19 devstack quobyte-client[82137]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.connection_debug = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.connection_parameters = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.connection_recycle_time = 3600 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.connection_trace = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.db_inc_retry_interval = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.db_max_retries = 20 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.db_max_retry_interval = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.db_retry_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:19 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.max_overflow = 50 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.max_pool_size = 5 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.max_retries = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.mysql_wsrep_sync_wait = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.pool_timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.retry_interval = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.slave_connection = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.sqlite_synchronous = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.synchronous_reader = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] database.use_db_reconnect = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.connection_string = messaging:// {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.es_doc_type = notification {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.es_scroll_size = 10000 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.es_scroll_time = 2m {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.filter_error_trace = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.hmac_keys = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.sentinel_service_name = mymaster {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.socket_timeout = 0.1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82133]: INFO cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b ... Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.trace_requests = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 -c /etc/quobyte/client-cinder.cfg {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler.trace_sqlalchemy = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler_jaeger.process_tags = {} {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler_jaeger.service_name_prefix = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] profiler_otlp.service_name_prefix = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.enforce_new_defaults = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: WARNING oslo_config.cfg [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.enforce_scope = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.policy_default_rule = default {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.policy_file = policy.yaml {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.group = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.helper_command = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] privsep_osbrick.user = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.group = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.helper_command = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] cinder_sys_admin.user = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.auth_section = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.auth_type = password {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.cafile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.collect_timing = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack sudo[82138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 -c /etc/quobyte/client-cinder.cfg Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.send_service_user_token = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack sudo[82138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.split_loggers = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] service_user.timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.auth_section = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.auth_type = password {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.collect_timing = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.region_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.split_loggers = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] glance.timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.backend_availability_zone = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.chap_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.chap_username = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.disk_geometry = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_client_cert = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_client_cert_key = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_data_namespace = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.driver_use_ssl = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.extra_capabilities = {} {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.filter_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.goodness_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iscsi_target_flags = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iscsi_write_cache = on {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iser_helper = tgtadm {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iser_port = 3260 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_host = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_login = admin {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_mount_options = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_private_key = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_share_path = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.num_shell_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.quobyte_volume_url = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.replication_device = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.report_discard_supported = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.reserved_percentage = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_helper = tgtadm {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_port = 3260 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_protocol = iscsi {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.trace_flags = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.unique_fqdn_network = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.use_chap_auth = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_backend_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_clear = zero {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_clear_ionice = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_clear_size = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_reports.file_event_handler = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_reports.log_dir = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.backend_availability_zone = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.backend_host = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.chap_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.chap_username = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.chiscsi_conf = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.disk_geometry = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_client_cert = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_data_namespace = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.driver_use_ssl = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.extra_capabilities = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.filter_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.goodness_function = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iser_helper = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iser_ip_address = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iser_port = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.iser_target_prefix = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_host = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_login = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_mount_options = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_password = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_private_key = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_share_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_ssh_port = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.num_shell_tries = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.nvmet_port_id = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.replication_device = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.report_discard_supported = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.reserved_percentage = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.scst_target_driver = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.storage_protocol = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_helper = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_ip_address = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_port = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_prefix = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_protocol = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.trace_flags = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.use_chap_auth = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_clear = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_clear_size = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] QuobyteHD.volumes_dir = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_notifications.driver = [] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_notifications.retry = -1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] key_manager.fixed_key = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.barbican_api_version = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.barbican_endpoint = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.barbican_endpoint_type = public {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.barbican_region_name = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.cafile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.collect_timing = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.number_of_retries = 60 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.retry_delay = 1 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.send_service_user_token = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.split_loggers = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.verify_ssl = True {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican.verify_ssl_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.auth_section = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.auth_type = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.cafile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.certfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.collect_timing = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.insecure = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.keyfile = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.split_loggers = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] barbican_service_user.timeout = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.approle_role_id = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.approle_secret_id = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.kv_mountpoint = secret {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.kv_path = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.kv_version = 2 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.namespace = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.root_token_id = **** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.ssl_ca_crt_file = None {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.timeout = 60.0 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.use_ssl = False {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:20 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] ******************************************************************************** {{(pid=82017) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 19:53:20 devstack sudo[82138]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.510s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:20 devstack cinder-volume[82133]: INFO cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b succeeded Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.541s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:20 devstack sudo[82241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:20 devstack sudo[82241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:20 devstack sudo[82241]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.376s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:20 devstack cinder-volume[82133]: INFO cinder.volume.driver [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Driver hasn't implemented _init_vendor_properties() Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.volume.driver [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82133) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_db.sqlalchemy.engines [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82133) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG dbcounter [-] [82133] Writer thread running {{(pid=82133) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.db.sqlalchemy.api [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Building query based on filter {{(pid=82133) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.image.image_utils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82133) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 19:53:20 devstack cinder-volume[82133]: INFO cinder.keymgr.migration [None req-8d85fa52-ec25-46df-aa46-71974f138823 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:20 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:21 devstack sudo[82244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:21 devstack sudo[82244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:21 devstack sudo[82244]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.368s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG cinder.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Notifying Schedulers of capabilities ... {{(pid=82133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:53:21 devstack cinder-volume[82133]: INFO cinder.volume.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Driver initialization completed successfully. Apr 02 19:53:21 devstack cinder-volume[82133]: INFO cinder.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Initiating service 3 cleanup Apr 02 19:53:21 devstack cinder-volume[82133]: INFO cinder.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Service 3 cleanup completed. Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG cinder.service [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Creating RPC server for service cinder-volume {{(pid=82133) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG cinder.service [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82133) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 19:53:21 devstack cinder-volume[82133]: INFO cinder.volume.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:21 devstack sudo[82250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:21 devstack sudo[82250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:21 devstack sudo[82250]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:21 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.440s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:21 devstack cinder-volume[82133]: INFO cinder.volume.manager [None req-4de3ec12-016d-476d-bd5c-a2c7725e89bc None None] Driver post RPC initialization completed successfully. Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82133) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG cinder.volume.drivers.quobyte [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82133) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82133) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:24 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:24 devstack sudo[82381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:24 devstack sudo[82381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:24 devstack cinder-volume[82017]: INFO oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Caught SIGTERM, stopping children Apr 02 19:53:24 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Acquiring lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:24 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Acquired lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:24 devstack cinder-volume[82017]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Releasing lock "singleton_lock" {{(pid=82017) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:24 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Stop services. {{(pid=82017) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 19:53:24 devstack cinder-volume[82017]: DEBUG oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Killing children. {{(pid=82017) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 19:53:24 devstack cinder-volume[82017]: INFO oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Waiting on 1 children to exit Apr 02 19:53:25 devstack sudo[82381]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:25 devstack cinder-volume[82133]: DEBUG oslo_concurrency.processutils [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.698s {{(pid=82133) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:25 devstack cinder-volume[82133]: DEBUG cinder.manager [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Notifying Schedulers of capabilities ... {{(pid=82133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Unable to connect to AMQP server on 192.168.122.233:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server [None req-fc86410b-0949-4991-9359-1cf364ceeb40 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.233:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server method() Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return _publish( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server listener(*args) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.233:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 02 19:53:25 devstack cinder-volume[82133]: ERROR oslo_messaging.rpc.server Apr 02 19:53:25 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Acquiring lock "singleton_lock" {{(pid=82133) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:25 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Acquired lock "singleton_lock" {{(pid=82133) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:25 devstack cinder-volume[82133]: DEBUG oslo_concurrency.lockutils [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Releasing lock "singleton_lock" {{(pid=82133) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:25 devstack cinder-volume[82133]: WARNING amqp [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 19:53:25 devstack cinder-volume[82133]: WARNING amqp [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 19:53:25 devstack cinder-volume[82017]: INFO oslo_service.backend._eventlet.service [None req-18fd66bc-7700-4e53-8db6-d5e945084117 None None] Child 82133 exited with status 0 Apr 02 19:53:27 devstack cinder-volume[82387]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 19:53:27 devstack cinder-volume[82387]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 19:53:27 devstack cinder-volume[82387]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82387) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 19:53:28 devstack cinder-volume[82387]: INFO dbcounter [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Registered counter for database cinder Apr 02 19:53:28 devstack cinder-volume[82387]: DEBUG oslo_db.sqlalchemy.engines [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:28 devstack cinder-volume[82387]: DEBUG dbcounter [-] [82387] Writer thread running {{(pid=82387) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:53:28 devstack cinder-volume[82387]: INFO cinder.rpc [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 19:53:28 devstack cinder-volume[82387]: INFO cinder.rpc [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 19:53:28 devstack cinder-volume[82387]: DEBUG oslo_db.sqlalchemy.engines [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:28 devstack cinder-volume[82387]: INFO cinder.volume.manager [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Determined volume DB was empty at startup. Apr 02 19:53:28 devstack cinder-volume[82387]: DEBUG cinder.volume.manager [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82387) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 19:53:28 devstack cinder-volume[82387]: WARNING stevedore.named [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 19:53:28 devstack cinder-volume[82387]: WARNING castellan.key_manager [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:53:28 devstack cinder-volume[82387]: WARNING cinder.keymgr.conf_key_mgr [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 19:53:28 devstack cinder-volume[82387]: INFO cinder.volume.manager [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 19:53:28 devstack cinder-volume[82387]: DEBUG oslo_db.sqlalchemy.engines [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:29 devstack cinder-volume[82387]: INFO oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Starting 1 workers Apr 02 19:53:29 devstack cinder-volume[82597]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Started child 82597 {{(pid=82387) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Full set of CONF: {{(pid=82387) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] ******************************************************************************** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Configuration options gathered from: {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] ================================================================================ {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] allow_availability_zone_fallback = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] allow_compression_on_image_upload = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] allowed_direct_url_schemes = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] api_rate_limit = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] auth_strategy = keystone {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_availability_zone = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_host = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_stats_polling_interval = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backup_api_class = cinder.backup.api.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backup_name_template = backup-%s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backup_use_same_host = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backup_use_temp_snapshot = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] chap_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] chap_username = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_internal_tenant_project_id = 10ba0d8ed5ed4e968a6973c2ea3779d6 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_internal_tenant_user_id = a1580f00b78948d2abe34c2e0e5ae444 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cluster = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] compression_format = gzip {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] compute_api_class = cinder.compute.nova.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] config_dir = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] config_source = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] control_exchange = openstack {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] debug = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] default_availability_zone = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] default_group_type = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] default_volume_type = QuobyteHD {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] disk_geometry = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_client_cert = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_client_cert_key = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_data_namespace = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_ssl_cert_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_ssl_cert_verify = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] driver_use_ssl = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] enable_new_services = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] enable_unsupported_driver = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] enabled_backends = ['QuobyteHD'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] enforce_multipath_for_image_xfer = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] filter_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82597) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_api_insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_api_servers = ['http://192.168.122.233/image'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_api_ssl_compression = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_ca_certificates_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_catalog_info = image:glance:publicURL {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_num_retries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance_request_timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] goodness_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] graceful_shutdown_timeout = 5 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] group_api_class = cinder.group.api.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] host = devstack {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_compress_on_upload = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_conversion_address_space_limit = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_conversion_cpu_limit = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_conversion_disable = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_upload_use_cinder_backend = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_upload_use_internal_tenant = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_volume_cache_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_volume_cache_max_count = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] image_volume_cache_max_size_gb = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] init_host_max_objects_retrieval = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] instance_format = [instance: %(uuid)s] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iscsi_target_flags = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iscsi_write_cache = on {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iser_helper = tgtadm {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iser_ip_address = 192.168.122.233 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iser_port = 3260 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_color = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_config_append = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_dir = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_options = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_rotate_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_rotate_interval_type = days {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] log_rotation_type = none {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] max_age = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] max_logfile_count = 30 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] max_logfile_size_mb = 200 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] max_over_subscription_ratio = 20.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] message_reap_interval = 86400 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] message_ttl = 2592000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] migration_create_volume_timeout_secs = 300 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] monkey_patch = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] monkey_patch_modules = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] my_ip = 192.168.122.233 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] no_snapshot_gb_quota = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] num_iser_scan_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] num_shell_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] num_volume_device_scan_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] nvmeof_conn_info_version = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] nvmet_ns_id = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] nvmet_port_id = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_max_limit = 1000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_ext_list = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_listen = 0.0.0.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_listen_port = 8776 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_use_ssl = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] osapi_volume_workers = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] per_volume_size_limit = -1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] periodic_fuzzy_delay = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] periodic_interval = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] project_id_regex = [0-9a-f\-]+ {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] public_endpoint = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] publish_errors = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_backup_gigabytes = 1000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_backups = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_gigabytes = 1000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_groups = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_snapshots = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] quota_volumes = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] rate_limit_burst = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] rate_limit_except_level = CRITICAL {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] rate_limit_interval = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] reinit_driver_count = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] replication_device = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] report_discard_supported = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] report_interval = 120 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] reservation_clean_interval = 86400 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] reservation_expire = 86400 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] reserved_image_namespaces = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] reserved_percentage = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] rpc_response_timeout = 120 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82597) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] run_external_periodic_tasks = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack quobyte-client[82603]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 19:53:29 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 19:53:29 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 19:53:29 devstack quobyte-client[82603]: Invalid parameters found, error: missing mount point. Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] scst_target_driver = iscsi {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack quobyte-client[82603]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Running cmd (subprocess): mount.quobyte {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:29 devstack quobyte-client[82603]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] scst_target_iqn_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_down_time = 720 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] shell_completion = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] snapshot_name_template = snapshot-%s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] split_loggers = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] state_path = /opt/stack/data/cinder {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] storage_availability_zone = nova {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] storage_protocol = iSCSI {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] syslog_log_facility = LOG_USER {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_helper = lioadm {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_ip_address = 192.168.122.233 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_port = 3260 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_protocol = iscsi {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] target_secondary_ip_addresses = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] trace_flags = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] transfer_api_class = cinder.transfer.api.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] transport_url = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] until_refresh = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_chap_auth = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_default_quota_class = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_journal = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_json = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_multipath_for_image_xfer = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_stderr = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] use_syslog = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] verify_glance_signatures = enabled {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_api_class = cinder.volume.api.API {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_backend_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_clear = zero {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_clear_ionice = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_clear_size = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_copy_bps_limit = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_dd_blocksize = 1M {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_name_template = volume-%s {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_service_inithost_offload = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volume_usage_audit_period = month {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] zoning_mode = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_concurrency.disable_process_locking = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.admin_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.admin_token = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.admin_user = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_admin_prefix = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_port = 35357 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_protocol = https {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_section = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_type = password {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_uri = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.auth_version = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.cache = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.identity_uri = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.include_service_catalog = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.interface = public {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_password = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcache_username = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.region_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.service_type = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.233/identity {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.backend = dogpile.cache.null {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.backend_argument = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.backend_expiration_time = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.config_prefix = cache.oslo {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.debug_cache_backend = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.enable_retry_client = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.enable_socket_keepalive = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.enforce_fips_mode = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.expiration_time = 600 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.hashclient_retry_attempts = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_dead_retry = 300 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_pool_maxsize = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_sasl_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.proxies = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.redis_db = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.redis_server = localhost:6379 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.retry_attempts = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.retry_delay = 0.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.socket_keepalive_count = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.socket_keepalive_idle = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.socket_keepalive_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.socket_timeout = 1.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.tls_allowed_ciphers = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.tls_cafile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.tls_certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.tls_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.tls_keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cache.username = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] coordination.backend_url = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.asyncio_connection = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.asyncio_slave_connection = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.backend = sqlalchemy {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.connection = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.connection_debug = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.connection_parameters = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.connection_recycle_time = 3600 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.connection_trace = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.db_inc_retry_interval = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.db_max_retries = 20 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.db_max_retry_interval = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.db_retry_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.max_overflow = 50 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.max_pool_size = 5 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.max_retries = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.mysql_wsrep_sync_wait = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.pool_timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.retry_interval = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.slave_connection = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.sqlite_synchronous = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.synchronous_reader = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] database.use_db_reconnect = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.connection_string = messaging:// {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.es_doc_type = notification {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.es_scroll_size = 10000 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.es_scroll_time = 2m {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.filter_error_trace = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.hmac_keys = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.sentinel_service_name = mymaster {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.socket_timeout = 0.1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.trace_requests = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler.trace_sqlalchemy = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler_jaeger.process_tags = {} {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler_jaeger.service_name_prefix = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] profiler_otlp.service_name_prefix = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.enforce_new_defaults = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: WARNING oslo_config.cfg [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.enforce_scope = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.policy_default_rule = default {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.policy_file = policy.yaml {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_policy.remote_timeout = 60.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack sudo[82615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:29 devstack sudo[82615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.group = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.helper_command = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] privsep_osbrick.user = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.group = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.helper_command = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] cinder_sys_admin.user = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.auth_section = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.auth_type = password {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.cafile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.collect_timing = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.send_service_user_token = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.split_loggers = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] service_user.timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.auth_section = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.auth_type = password {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.collect_timing = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.region_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.split_loggers = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] glance.timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.backend_availability_zone = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.chap_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.chap_username = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.disk_geometry = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_client_cert = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_client_cert_key = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_data_namespace = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.driver_use_ssl = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.extra_capabilities = {} {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.filter_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.goodness_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iscsi_target_flags = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iscsi_write_cache = on {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iser_helper = tgtadm {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iser_ip_address = 192.168.122.233 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iser_port = 3260 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_host = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_login = admin {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_mount_options = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_private_key = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_share_path = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_ssh_port = 22 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.num_shell_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.quobyte_volume_url = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.replication_device = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.report_discard_supported = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.reserved_percentage = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_helper = tgtadm {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_ip_address = 192.168.122.233 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_port = 3260 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_protocol = iscsi {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.trace_flags = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.unique_fqdn_network = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.use_chap_auth = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_backend_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_clear = zero {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_clear_ionice = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_clear_size = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_reports.file_event_handler = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_reports.log_dir = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.backend_availability_zone = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.backend_host = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.chap_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.chap_username = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.chiscsi_conf = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.disk_geometry = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_client_cert = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_data_namespace = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.driver_use_ssl = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.extra_capabilities = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.filter_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.goodness_function = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iscsi_target_flags = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iscsi_write_cache = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iser_helper = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iser_ip_address = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iser_port = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.iser_target_prefix = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_host = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_login = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_mount_options = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_password = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_private_key = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_share_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_ssh_port = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.num_shell_tries = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nvmet_ns_id = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.nvmet_port_id = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.replication_device = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.report_discard_supported = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.reserved_percentage = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.scst_target_driver = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.storage_protocol = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_helper = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_ip_address = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_port = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_prefix = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_protocol = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.trace_flags = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.unique_fqdn_network = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.use_chap_auth = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_clear = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_clear_ionice = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_clear_size = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] QuobyteHD.volumes_dir = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.ssl_version = {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_notifications.driver = [] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_notifications.retry = -1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] key_manager.fixed_key = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.barbican_api_version = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.barbican_endpoint = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.barbican_endpoint_type = public {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.barbican_region_name = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.cafile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.collect_timing = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.number_of_retries = 60 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.retry_delay = 1 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.send_service_user_token = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.split_loggers = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.verify_ssl = True {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican.verify_ssl_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.auth_section = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.auth_type = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.cafile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.certfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.collect_timing = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.insecure = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.keyfile = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.split_loggers = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] barbican_service_user.timeout = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.approle_role_id = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.approle_secret_id = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.kv_mountpoint = secret {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.kv_path = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.kv_version = 2 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.namespace = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.root_token_id = **** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.ssl_ca_crt_file = None {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.timeout = 60.0 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.use_ssl = False {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 19:53:29 devstack cinder-volume[82387]: DEBUG oslo_service.backend._eventlet.service [None req-979c7e8b-4b6a-41e3-aabd-842265a2950d None None] ******************************************************************************** {{(pid=82387) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 19:53:29 devstack sudo[82615]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:29 devstack cinder-volume[82597]: INFO cinder.volume.driver [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Driver hasn't implemented _init_vendor_properties() Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.driver [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82597) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_db.sqlalchemy.engines [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writer thread running {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.db.sqlalchemy.api [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Building query based on filter {{(pid=82597) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82597) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:29 devstack sudo[82633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:29 devstack cinder-volume[82597]: INFO cinder.keymgr.migration [None req-8775a2b9-dae1-4e0d-ba65-26f6bffbb29c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 19:53:29 devstack sudo[82633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:30 devstack sudo[82633]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.421s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:53:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Driver initialization completed successfully. Apr 02 19:53:30 devstack cinder-volume[82597]: INFO cinder.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Initiating service 3 cleanup Apr 02 19:53:30 devstack cinder-volume[82597]: INFO cinder.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Service 3 cleanup completed. Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG cinder.service [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Creating RPC server for service cinder-volume {{(pid=82597) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG cinder.service [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82597) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 19:53:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:53:30 devstack sudo[82638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:53:30 devstack sudo[82638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:53:30 devstack sudo[82638]: pam_unix(sudo:session): session closed for user root Apr 02 19:53:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:53:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c63b7c4f-8ffd-48e7-a8b5-2e678c8ce404 None None] Driver post RPC initialization completed successfully. Apr 02 19:53:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b15295d3-89ca-4bf6-ac96-7fe6a3a3d4e9 tempest-BackendsCapabilitiesAdminTestsJSON-56383532 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82597) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 19:53:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2ab16f0e-3a8a-44eb-95f2-267db002292c tempest-BackendsCapabilitiesAdminTestsJSON-56383532 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82597) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 19:53:39 devstack cinder-volume[82387]: DEBUG dbcounter [-] [82387] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82387) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:53:40 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:53:40 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=2 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Flow 'volume_create_manager' (6d7f5de8-9f0d-467c-bbc6-9f93e419a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b23b669-a921-44c0-bb2f-c370b3e65e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2839def1-3f8c-4a7e-941c-1709d6feea95 tempest-GroupsTest-371654573 None] Group tempest-Group1-2096980332: creating Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b23b669-a921-44c0-bb2f-c370b3e65e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-124191863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52044d5a4380413583ae5f4b00731dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:29Z,use_quota=True,user_id='1779f4a25ba94725ae151f8ca99c131e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6646b823-8ded-4664-8887-ea3385eba7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6646b823-8ded-4664-8887-ea3385eba7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8854382-ef71-49e6-8182-cff13e662633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8854382-ef71-49e6-8182-cff13e662633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b', 'volume_name': 'volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a8065e-11e4-481a-9be2-687a21e0c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a8065e-11e4-481a-9be2-687a21e0c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3aa2dd-69f7-4753-b47f-82b12d2e9ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Volume 9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b', 'volume_size': 1} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-124191863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52044d5a4380413583ae5f4b00731dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:29Z,use_quota=True,user_id='1779f4a25ba94725ae151f8ca99c131e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Creating volume 9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:28 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:28 devstack sudo[82972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b 1073741824 Apr 02 19:54:28 devstack sudo[82972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2839def1-3f8c-4a7e-941c-1709d6feea95 tempest-GroupsTest-371654573 None] Group tempest-Group1-2096980332: created successfully Apr 02 19:54:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2839def1-3f8c-4a7e-941c-1709d6feea95 tempest-GroupsTest-371654573 None] Create group completed successfully. Apr 02 19:54:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-706be6b3-287e-4f5d-a06b-075cb7a97ec9 tempest-GroupsTest-371654573 None] Group tempest-Group2-1516282733: creating Apr 02 19:54:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-706be6b3-287e-4f5d-a06b-075cb7a97ec9 tempest-GroupsTest-371654573 None] Group tempest-Group2-1516282733: created successfully Apr 02 19:54:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-706be6b3-287e-4f5d-a06b-075cb7a97ec9 tempest-GroupsTest-371654573 None] Create group completed successfully. Apr 02 19:54:29 devstack sudo[82972]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b 1073741824" returned: 0 in 0.606s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:29 devstack sudo[83291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b Apr 02 19:54:29 devstack sudo[83291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:29 devstack sudo[83291]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" returned: 0 in 0.406s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3aa2dd-69f7-4753-b47f-82b12d2e9ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219c1bf5-c2c6-4b05-b7ff-dd620ed45d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Volume volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b (9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b): created successfully Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219c1bf5-c2c6-4b05-b7ff-dd620ed45d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Flow 'volume_create_manager' (6d7f5de8-9f0d-467c-bbc6-9f93e419a838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-5dd510cb-0b65-4025-984f-f85fe93618bf tempest-VolumesAdminNegativeTest-1859700888 None] Created volume successfully. Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Acquiring lock "cinder-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "cinder-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Acquiring lock "cinder-quobyte-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "cinder-quobyte-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:30 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpt4x7me3j/privsep.sock'] Apr 02 19:54:30 devstack sudo[83299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpt4x7me3j/privsep.sock Apr 02 19:54:30 devstack sudo[83299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (3068813d-ded7-4eea-8679-031cb8ff78a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1b8afd-2e85-4423-8039-aa0f5b20989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1b8afd-2e85-4423-8039-aa0f5b20989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-204660939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deb4553f-77da-4b28-b552-bed06ef3bb4a,host='devstack@QuobyteHD#QuobyteHD',id=a3434422-3859-4163-9464-0b89a1184106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:31Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(073893c3-7917-42d4-b700-276d4a0d14e5),volume_type_id=073893c3-7917-42d4-b700-276d4a0d14e5)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71f123c-9f6a-4393-bde7-ba61f5b0f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71f123c-9f6a-4393-bde7-ba61f5b0f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd1e6b-ba13-4b40-9d3d-5340d67cbd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd1e6b-ba13-4b40-9d3d-5340d67cbd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3434422-3859-4163-9464-0b89a1184106', 'volume_name': 'volume-a3434422-3859-4163-9464-0b89a1184106', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fbd7bd-1496-4696-8234-7ab2b239fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fbd7bd-1496-4696-8234-7ab2b239fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60902af-168e-4a99-882c-6a326436b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:30 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Volume a3434422-3859-4163-9464-0b89a1184106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3434422-3859-4163-9464-0b89a1184106', 'volume_size': 1} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=deb4553f-77da-4b28-b552-bed06ef3bb4a,created_at=2026-04-02T17:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-204660939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deb4553f-77da-4b28-b552-bed06ef3bb4a,host='devstack@QuobyteHD#QuobyteHD',id=a3434422-3859-4163-9464-0b89a1184106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:31Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(073893c3-7917-42d4-b700-276d4a0d14e5),volume_type_id=073893c3-7917-42d4-b700-276d4a0d14e5)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Creating volume a3434422-3859-4163-9464-0b89a1184106 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:30 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:30 devstack sudo[83301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 1073741824 Apr 02 19:54:30 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:31 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 1073741824" returned: 0 in 0.661s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:31 devstack sudo[83312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 Apr 02 19:54:31 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:32 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106" returned: 0 in 0.751s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60902af-168e-4a99-882c-6a326436b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3434422-3859-4163-9464-0b89a1184106', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017474ad-5271-43ba-b32e-7596321bb090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:32 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Volume volume-a3434422-3859-4163-9464-0b89a1184106 (a3434422-3859-4163-9464-0b89a1184106): created successfully Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017474ad-5271-43ba-b32e-7596321bb090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (3068813d-ded7-4eea-8679-031cb8ff78a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e0ae209e-8754-41ba-9943-925b5bcf3c9f tempest-GroupsTest-371654573 None] Created volume successfully. Apr 02 19:54:32 devstack sudo[83299]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:32 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Spawned new privsep daemon via rootwrap Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Accepted privsep connection to /tmp/tmpt4x7me3j/privsep.sock {{(pid=82597) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 02 19:54:32 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 02 19:54:32 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 02 19:54:32 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 02 19:54:32 devstack cinder-volume[82597]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83318 Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0dd99-2e33-40f1-9bb9-b139c1e2c916]: (2,) {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5563af0-55b9-4ec2-b07f-78b685faa6a1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:32 devstack sudo[83320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b Apr 02 19:54:32 devstack sudo[83320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:33 devstack sudo[83320]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" returned: 0 in 0.918s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:33 devstack sudo[83336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b Apr 02 19:54:33 devstack sudo[83336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Acquiring lock "cinder-quobyte-a3434422-3859-4163-9464-0b89a1184106" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-a3434422-3859-4163-9464-0b89a1184106" acquired by "delete_volume" :: waited 0.027s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8681f7e-bcb3-445a-9356-472066ee03fe]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:34 devstack sudo[83336]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" returned: 0 in 0.835s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "cinder-quobyte-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b" released by "delete_volume" :: held 3.542s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:34 devstack sudo[83357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 Apr 02 19:54:34 devstack sudo[83357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:34 devstack cinder-volume[82597]: WARNING cinder.quota [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:34 devstack cinder-volume[82597]: WARNING cinder.quota [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Created reservations ['ef4736d8-49c1-40ef-a16c-7115b7a7d649', '27f0862a-c124-4704-9d43-2a1a4c72f254', 'c9ca318e-1c3a-4760-9d6f-141b4917b8b0', '12800bbd-4ee4-4187-9ee1-5dccedd674fa'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:34 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:54:34 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:35 devstack sudo[83357]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106" returned: 0 in 0.903s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:35 devstack sudo[83367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106 Apr 02 19:54:35 devstack sudo[83367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:35 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.810s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:35 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:54:35 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Deleted volume successfully. Apr 02 19:54:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e95b95cd-1300-4dc4-8883-8f6d0793f83c tempest-VolumesAdminNegativeTest-1859700888 None] Lock "cinder-9ef78dba-dbd5-4eb4-9071-7bdef7e85c3b-delete_volume" released by "delete_volume" :: held 4.714s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:36 devstack sudo[83367]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3434422-3859-4163-9464-0b89a1184106" returned: 0 in 1.065s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-a3434422-3859-4163-9464-0b89a1184106" released by "delete_volume" :: held 1.990s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Created reservations ['90236bbd-e17c-4e49-9a03-03eaa1ecd982'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:36 devstack cinder-volume[82597]: WARNING cinder.quota [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2068305895 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2068305895, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:36 devstack cinder-volume[82597]: WARNING cinder.quota [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2068305895 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2068305895, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Created reservations ['60f07f81-fe5f-48cd-a5b2-4b4a4127ce32', '0ed478f8-62dd-4a61-af78-879f9654f34f', 'f4e93ffd-ead0-49dd-88f6-193107390242', 'abb46499-251a-404e-9bc1-be499f1850ac'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:36 devstack sudo[83394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:54:36 devstack sudo[83394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Created reservations ['6eb7b67e-8069-4b19-ae32-398209309434'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:36 devstack sudo[83401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:54:36 devstack sudo[83401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:37 devstack sudo[83401]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:54:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9882fdf5-45fe-40f9-a867-2e8e52ef727f tempest-GroupsTest-371654573 None] Delete group completed successfully. Apr 02 19:54:37 devstack sudo[83394]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.906s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:54:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9e6685fe-c9de-4951-b2c1-417dbe486603 tempest-GroupsTest-371654573 None] Delete group completed successfully. Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Flow 'volume_create_manager' (550e41e2-550d-4368-aa81-697e6567ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5035c3a2-72e2-4c72-a757-bb6f0b01255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5035c3a2-72e2-4c72-a757-bb6f0b01255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1377096049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10f056d-a264-4281-b06a-31860f584706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1d6c90a5fd4d569678bbf3383fe1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:38Z,use_quota=True,user_id='86891d3de08343279a11be9ebea6327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432c4299-88ae-4d2e-898c-efef8f848247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432c4299-88ae-4d2e-898c-efef8f848247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55ec10d-0ab1-45c0-89c4-2f520c8b2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55ec10d-0ab1-45c0-89c4-2f520c8b2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10f056d-a264-4281-b06a-31860f584706', 'volume_name': 'volume-e10f056d-a264-4281-b06a-31860f584706', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ef436e-64e7-4380-ba9b-98d4fd487dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ef436e-64e7-4380-ba9b-98d4fd487dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb635ff-0771-48be-a734-f614ee6f11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Volume e10f056d-a264-4281-b06a-31860f584706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10f056d-a264-4281-b06a-31860f584706', 'volume_size': 1} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1377096049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10f056d-a264-4281-b06a-31860f584706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1d6c90a5fd4d569678bbf3383fe1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:38Z,use_quota=True,user_id='86891d3de08343279a11be9ebea6327e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Creating volume e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:37 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:37 devstack sudo[83438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 1073741824 Apr 02 19:54:37 devstack sudo[83438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-93c01195-7f68-4512-a3d6-dcd367bf2670 tempest-GroupsTest-371654573 None] Group tempest-GroupsTest-Group-931695847: creating Apr 02 19:54:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-93c01195-7f68-4512-a3d6-dcd367bf2670 tempest-GroupsTest-371654573 None] Group tempest-GroupsTest-Group-931695847: created successfully Apr 02 19:54:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-93c01195-7f68-4512-a3d6-dcd367bf2670 tempest-GroupsTest-371654573 None] Create group completed successfully. Apr 02 19:54:38 devstack sudo[83438]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 1073741824" returned: 0 in 0.570s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:38 devstack sudo[83446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 Apr 02 19:54:38 devstack sudo[83446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:38 devstack sudo[83446]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706" returned: 0 in 0.465s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb635ff-0771-48be-a734-f614ee6f11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10f056d-a264-4281-b06a-31860f584706', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a96620-11cc-4a3f-b332-91b0968a84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:38 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Volume volume-e10f056d-a264-4281-b06a-31860f584706 (e10f056d-a264-4281-b06a-31860f584706): created successfully Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a96620-11cc-4a3f-b332-91b0968a84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Flow 'volume_create_manager' (550e41e2-550d-4368-aa81-697e6567ee54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b7065932-0d02-41df-90f9-606a3d0e55e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Created volume successfully. Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (3fb2380e-20a1-4c1d-8b8f-ee022019e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a72fb22-efa3-42e2-80bf-bf649087676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a72fb22-efa3-42e2-80bf-bf649087676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499647171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=740a114c-bcbd-4a42-a854-eb582f87721d,host='devstack@QuobyteHD#QuobyteHD',id=9f49b07f-cf56-4c9b-8ad2-71129c464065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:39Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2d60a50-2d1b-4d5e-980d-d17c6006df3b),volume_type_id=d2d60a50-2d1b-4d5e-980d-d17c6006df3b)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb31b63-f6e2-4787-887c-66fe047961f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb31b63-f6e2-4787-887c-66fe047961f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1743ee4-254f-4c3b-8258-83853a12ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1743ee4-254f-4c3b-8258-83853a12ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f49b07f-cf56-4c9b-8ad2-71129c464065', 'volume_name': 'volume-9f49b07f-cf56-4c9b-8ad2-71129c464065', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e9990-1ced-403b-9e80-39471a2bb230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234e9990-1ced-403b-9e80-39471a2bb230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8149c407-f75c-46e5-849a-9a2767e9b1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:39 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Volume 9f49b07f-cf56-4c9b-8ad2-71129c464065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f49b07f-cf56-4c9b-8ad2-71129c464065', 'volume_size': 1} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=740a114c-bcbd-4a42-a854-eb582f87721d,created_at=2026-04-02T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499647171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=740a114c-bcbd-4a42-a854-eb582f87721d,host='devstack@QuobyteHD#QuobyteHD',id=9f49b07f-cf56-4c9b-8ad2-71129c464065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:39Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2d60a50-2d1b-4d5e-980d-d17c6006df3b),volume_type_id=d2d60a50-2d1b-4d5e-980d-d17c6006df3b)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Creating volume 9f49b07f-cf56-4c9b-8ad2-71129c464065 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:39 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:39 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 1073741824 Apr 02 19:54:39 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:40 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 1073741824" returned: 0 in 0.644s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:40 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 Apr 02 19:54:40 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:40 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065" returned: 0 in 0.409s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8149c407-f75c-46e5-849a-9a2767e9b1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f49b07f-cf56-4c9b-8ad2-71129c464065', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86aa0c1-6d09-4699-9b6c-a6cb6b61b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Creating offline snapshot b5fc5074-d445-4c4b-8f9a-493c5938458d of volume e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:54:40 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Volume volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 (9f49b07f-cf56-4c9b-8ad2-71129c464065): created successfully Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86aa0c1-6d09-4699-9b6c-a6cb6b61b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (3fb2380e-20a1-4c1d-8b8f-ee022019e493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5005a121-7608-4a96-9f62-7eb87e3918de]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:40 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-64636667-cf1e-48d0-95bc-28c2a4e71dd9 tempest-GroupsTest-371654573 None] Created volume successfully. Apr 02 19:54:40 devstack sudo[83489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 Apr 02 19:54:40 devstack sudo[83489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:41 devstack sudo[83489]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706" returned: 0 in 0.593s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:41 devstack sudo[83494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d 1G Apr 02 19:54:41 devstack sudo[83494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:42 devstack sudo[83494]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d 1G" returned: 0 in 0.705s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10f056d-a264-4281-b06a-31860f584706 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:42 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10f056d-a264-4281-b06a-31860f584706 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d Apr 02 19:54:42 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (94b15ac1-a691-4654-a622-3609db9fb528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bcd4c38-e55a-4111-ab6b-5af29aa1c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bcd4c38-e55a-4111-ab6b-5af29aa1c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981632748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=740a114c-bcbd-4a42-a854-eb582f87721d,host='devstack@QuobyteHD#QuobyteHD',id=7ea810ca-cb41-43f2-bf46-6cdbb3ca508e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:43Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2d60a50-2d1b-4d5e-980d-d17c6006df3b),volume_type_id=d2d60a50-2d1b-4d5e-980d-d17c6006df3b)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01cd6c6-b8a2-4178-9169-6476bcece411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01cd6c6-b8a2-4178-9169-6476bcece411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4d5e8f-9cec-41d0-8ec6-ffdd5f6fd643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4d5e8f-9cec-41d0-8ec6-ffdd5f6fd643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea810ca-cb41-43f2-bf46-6cdbb3ca508e', 'volume_name': 'volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ebb4df-8748-4ec7-a2b2-75c6c505e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ebb4df-8748-4ec7-a2b2-75c6c505e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8329473-e2b4-439a-8a5a-24207afa88ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Volume 7ea810ca-cb41-43f2-bf46-6cdbb3ca508e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e', 'volume_size': 1} Apr 02 19:54:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:43 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10f056d-a264-4281-b06a-31860f584706 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d" returned: 0 in 1.030s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:43 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d is being set with open permissions: ugo+rw Apr 02 19:54:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:43 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d Apr 02 19:54:43 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:43 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d" returned: 0 in 0.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:43 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info Apr 02 19:54:43 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:44 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info" returned: 0 in 0.539s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:44 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info is being set with open permissions: ugo+rw Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:44 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info Apr 02 19:54:44 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:44 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.info" returned: 0 in 0.579s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=740a114c-bcbd-4a42-a854-eb582f87721d,created_at=2026-04-02T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981632748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=740a114c-bcbd-4a42-a854-eb582f87721d,host='devstack@QuobyteHD#QuobyteHD',id=7ea810ca-cb41-43f2-bf46-6cdbb3ca508e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1303b2bafe23426e9b6542d689b045fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:43Z,use_quota=True,user_id='608634f8969e4956a23ce1da06e73155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2d60a50-2d1b-4d5e-980d-d17c6006df3b),volume_type_id=d2d60a50-2d1b-4d5e-980d-d17c6006df3b)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Creating volume 7ea810ca-cb41-43f2-bf46-6cdbb3ca508e {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:44 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:44 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e 1073741824 Apr 02 19:54:44 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-eac8072e-db6c-4ae7-8c4f-d76f4ddb4d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Create snapshot completed successfully Apr 02 19:54:45 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e 1073741824" returned: 0 in 0.778s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:45 devstack sudo[83550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e Apr 02 19:54:45 devstack sudo[83550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "cinder-b5fc5074-d445-4c4b-8f9a-493c5938458d-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-b5fc5074-d445-4c4b-8f9a-493c5938458d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "cinder-quobyte-b5fc5074-d445-4c4b-8f9a-493c5938458d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-b5fc5074-d445-4c4b-8f9a-493c5938458d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Deleting offline snapshot b5fc5074-d445-4c4b-8f9a-493c5938458d of volume e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] snapshot_file for this snap is: volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad1d561-fd6a-4197-9e60-bb538b0cb2c6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:46 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d Apr 02 19:54:46 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:46 devstack sudo[83550]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" returned: 0 in 1.096s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8329473-e2b4-439a-8a5a-24207afa88ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f4644a-9867-4105-8f3a-fc70fe02e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Volume volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e (7ea810ca-cb41-43f2-bf46-6cdbb3ca508e): created successfully Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f4644a-9867-4105-8f3a-fc70fe02e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Flow 'volume_create_manager' (94b15ac1-a691-4654-a622-3609db9fb528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-eda65a7e-d643-46ba-9263-059be22277ea tempest-GroupsTest-371654573 None] Created volume successfully. Apr 02 19:54:47 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d" returned: 0 in 0.783s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e10f056d-a264-4281-b06a-31860f584706(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[137aa006-8924-420e-84c9-4984a8d57670]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:47 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 Apr 02 19:54:47 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a9c30db7-4612-4cde-8371-cec523bb4160 tempest-GroupsTest-371654573 None] Update group completed successfully. Apr 02 19:54:47 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706" returned: 0 in 0.730s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:47 devstack sudo[83567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d Apr 02 19:54:47 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:48 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:48 devstack sudo[83572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d Apr 02 19:54:48 devstack sudo[83572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:48 devstack sudo[83572]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706.b5fc5074-d445-4c4b-8f9a-493c5938458d" returned: 0 in 0.524s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-b5fc5074-d445-4c4b-8f9a-493c5938458d" released by "_delete_snapshot" :: held 2.794s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" released by "delete_snapshot" :: held 2.819s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:49 devstack cinder-volume[82597]: WARNING cinder.quota [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Created reservations ['58236fa9-434c-4628-b5a4-bed959afd0dd', '56e96d65-55f9-4343-b92b-874f1ddbbca9', 'c679f6ec-12d0-4b0a-8546-24811ea825b4', 'fc4fe173-c71d-40a1-88d3-d121a32d07e6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b15c7f6a-5423-4009-80d6-63c3f2fb7ab7 tempest-GroupsTest-371654573 None] Update group completed successfully. Apr 02 19:54:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Delete snapshot completed successfully. Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a6939f29-217a-49f1-81b3-e5b389f8e329 tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-b5fc5074-d445-4c4b-8f9a-493c5938458d-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "cinder-e10f056d-a264-4281-b06a-31860f584706-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-e10f056d-a264-4281-b06a-31860f584706-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ee0c1-d3c6-4a47-a72a-78a4d2a16ef1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:49 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 Apr 02 19:54:49 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:50 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706" returned: 0 in 0.533s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:50 devstack sudo[83613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706 Apr 02 19:54:50 devstack sudo[83613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:50 devstack sudo[83613]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e10f056d-a264-4281-b06a-31860f584706" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-quobyte-e10f056d-a264-4281-b06a-31860f584706" released by "delete_volume" :: held 1.121s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Created reservations ['928e59d1-8464-4be9-8843-d4d608c23dd2', '64ecfa93-e5ec-48cd-b55a-d210abfffa14', '4a02cdee-18b0-45b9-8ca2-08a5cb9040e5', '9e630c07-236b-420a-a25e-ba0990d614b6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:50 devstack sudo[83618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:54:50 devstack sudo[83618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Acquiring lock "cinder-quobyte-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c105b-d648-4ac1-b227-f1fa80d28fec]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:50 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e Apr 02 19:54:50 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:51 devstack sudo[83618]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:54:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Deleted volume successfully. Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ccd5e645-dce9-4cd2-9b70-f65785ada0fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1110457724 None] Lock "cinder-e10f056d-a264-4281-b06a-31860f584706-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:51 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" returned: 0 in 0.604s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:51 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e Apr 02 19:54:51 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:51 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" returned: 0 in 0.572s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-7ea810ca-cb41-43f2-bf46-6cdbb3ca508e" released by "delete_volume" :: held 1.198s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Acquiring lock "cinder-quobyte-9f49b07f-cf56-4c9b-8ad2-71129c464065" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-9f49b07f-cf56-4c9b-8ad2-71129c464065" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5de8f07-e44e-459c-b14e-6755a29800c4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:54:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:52 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 Apr 02 19:54:52 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:52 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065" returned: 0 in 0.561s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:52 devstack sudo[83638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065 Apr 02 19:54:52 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:53 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9f49b07f-cf56-4c9b-8ad2-71129c464065" returned: 0 in 0.542s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "cinder-quobyte-9f49b07f-cf56-4c9b-8ad2-71129c464065" released by "delete_volume" :: held 1.127s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Created reservations ['d418fb8b-9f62-4012-92e4-6282ad0ffc1a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:53 devstack cinder-volume[82597]: WARNING cinder.quota [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-473693768 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-473693768, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:53 devstack cinder-volume[82597]: WARNING cinder.quota [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-473693768 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-473693768, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Created reservations ['17f4c71b-3644-4a55-91b7-0f047ee8d19c', '01e4fcda-74ea-4e47-a10a-c8294b13d553', '8458c23e-d43f-4a65-9184-93bdae075e89', '64b4313c-e1b7-421f-af85-f37f0e882b9f'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Created reservations ['f7550001-527a-4811-9436-52d359c18cb6', 'a86ccec3-186f-4c08-b563-16857e88bda3', 'bf9fb5d2-4f37-4bb1-a1df-0024752fbe44', '50579590-be3a-49bd-8fad-e6d801df4808'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:53 devstack sudo[83642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:54:53 devstack sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:54 devstack sudo[83642]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.697s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:54 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:54:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6c3ff71a-4fe2-4567-82a9-422d2e100aae tempest-GroupsTest-371654573 None] Delete group completed successfully. Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Flow 'volume_create_manager' (15ede923-46b6-412d-9e96-8ff5394364a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b9dfb-6ada-4f78-bedf-403dee8c9c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406b9dfb-6ada-4f78-bedf-403dee8c9c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2023970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f78c1-7d32-4168-bdca-ccccf5377b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dcbdfcde1f4a52a7259f3ffa4961ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:57Z,use_quota=True,user_id='ff776fe21e564afeb533459fdf656b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f056c3-7488-4a61-804a-818b46c97db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f056c3-7488-4a61-804a-818b46c97db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955f819-ee6b-46ff-a02e-f5a0d0c2f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955f819-ee6b-46ff-a02e-f5a0d0c2f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066f78c1-7d32-4168-bdca-ccccf5377b1e', 'volume_name': 'volume-066f78c1-7d32-4168-bdca-ccccf5377b1e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03905579-f5f7-4fbf-85a5-688b40b55e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03905579-f5f7-4fbf-85a5-688b40b55e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31911f-0cc9-41bf-b94a-02b47331a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:57 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Volume 066f78c1-7d32-4168-bdca-ccccf5377b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066f78c1-7d32-4168-bdca-ccccf5377b1e', 'volume_size': 1} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2023970729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f78c1-7d32-4168-bdca-ccccf5377b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dcbdfcde1f4a52a7259f3ffa4961ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:57Z,use_quota=True,user_id='ff776fe21e564afeb533459fdf656b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Creating volume 066f78c1-7d32-4168-bdca-ccccf5377b1e {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:57 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:57 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e 1073741824 Apr 02 19:54:57 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:58 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e 1073741824" returned: 0 in 0.919s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:58 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e Apr 02 19:54:58 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Flow 'volume_create_manager' (4267204b-df53-4aaa-8093-3be64dacec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e5a07-15d3-40bf-a4bf-4b735f569704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e" returned: 0 in 1.020s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e5a07-15d3-40bf-a4bf-4b735f569704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-777282917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f807514-d4e9-422b-98fa-fc8b2ec815bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0f7ce426b24049b046648a28ef05a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:59Z,use_quota=True,user_id='745034ea842345f0b98655e1333b1fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17bd7401-fea7-4894-9adb-45a06bf3304b),volume_type_id=17bd7401-fea7-4894-9adb-45a06bf3304b)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905617f6-c955-4246-9437-08c336a36946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905617f6-c955-4246-9437-08c336a36946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cc8107-a71d-429a-bb22-b26ef4c920ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cc8107-a71d-429a-bb22-b26ef4c920ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f807514-d4e9-422b-98fa-fc8b2ec815bd', 'volume_name': 'volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccebbee0-bd73-4741-9206-ee7620ffe0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccebbee0-bd73-4741-9206-ee7620ffe0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4160159d-dbdc-4968-be8d-604717840ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Volume 3f807514-d4e9-422b-98fa-fc8b2ec815bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd', 'volume_size': 1} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-777282917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f807514-d4e9-422b-98fa-fc8b2ec815bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0f7ce426b24049b046648a28ef05a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:54:59Z,use_quota=True,user_id='745034ea842345f0b98655e1333b1fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17bd7401-fea7-4894-9adb-45a06bf3304b),volume_type_id=17bd7401-fea7-4894-9adb-45a06bf3304b)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Creating volume 3f807514-d4e9-422b-98fa-fc8b2ec815bd {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:54:59 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31911f-0cc9-41bf-b94a-02b47331a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066f78c1-7d32-4168-bdca-ccccf5377b1e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b3fd47-77ca-4086-806b-9b349ccaef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:54:59 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd 1073741824 Apr 02 19:54:59 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:54:59 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Volume volume-066f78c1-7d32-4168-bdca-ccccf5377b1e (066f78c1-7d32-4168-bdca-ccccf5377b1e): created successfully Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b3fd47-77ca-4086-806b-9b349ccaef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:54:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Flow 'volume_create_manager' (15ede923-46b6-412d-9e96-8ff5394364a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:54:59 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fdc10452-73ca-477d-964e-98bdeef24102 tempest-ServerRescueNegativeTestJSON-1847754744 None] Created volume successfully. Apr 02 19:55:00 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd 1073741824" returned: 0 in 0.868s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:00 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd Apr 02 19:55:00 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:01 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd" returned: 0 in 0.847s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4160159d-dbdc-4968-be8d-604717840ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a938c79-ee6b-4a1c-b379-ef3b6ed13a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:01 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Volume volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd (3f807514-d4e9-422b-98fa-fc8b2ec815bd): created successfully Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a938c79-ee6b-4a1c-b379-ef3b6ed13a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Flow 'volume_create_manager' (4267204b-df53-4aaa-8093-3be64dacec20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-db055860-9bc6-4cd7-a0e6-e7f8abbdf793 tempest-VolumeTypesAccessTest-149574817 None] Created volume successfully. Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Acquiring lock "cinder-3f807514-d4e9-422b-98fa-fc8b2ec815bd-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "cinder-3f807514-d4e9-422b-98fa-fc8b2ec815bd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Acquiring lock "cinder-quobyte-3f807514-d4e9-422b-98fa-fc8b2ec815bd" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "cinder-quobyte-3f807514-d4e9-422b-98fa-fc8b2ec815bd" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c907c69-3f66-4285-a0ff-7ff391454ed9]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:02 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd Apr 02 19:55:02 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:03 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd" returned: 0 in 1.105s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:03 devstack sudo[83717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd Apr 02 19:55:03 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:03 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3f807514-d4e9-422b-98fa-fc8b2ec815bd" returned: 0 in 0.417s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "cinder-quobyte-3f807514-d4e9-422b-98fa-fc8b2ec815bd" released by "delete_volume" :: held 1.601s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:03 devstack cinder-volume[82597]: WARNING cinder.quota [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1043290041 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1043290041, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:55:03 devstack cinder-volume[82597]: WARNING cinder.quota [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1043290041 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1043290041, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Created reservations ['c3c1c3f1-8031-43dd-924a-47d04c44cfa5', 'fe8168fc-57bb-4d63-97c6-f643c2bc7047', '75726ff4-63d7-4ee8-b6ee-f14a32681ed1', '0ba2a4b6-2521-40cb-986a-5111dde62a84'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:03 devstack sudo[83720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:03 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:04 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.608s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:04 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:04 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Deleted volume successfully. Apr 02 19:55:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de6ad8ed-3d34-4948-8db6-fd8946450e21 tempest-VolumeTypesAccessTest-149574817 None] Lock "cinder-3f807514-d4e9-422b-98fa-fc8b2ec815bd-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:06 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:06 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:07 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.957s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:13 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=104,cinder:SELECT=76,cinder:INSERT=20,cinder:DELETE=4 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=74,cinder:UPDATE=73,cinder:INSERT=19,cinder:DELETE=7 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Flow 'volume_create_manager' (99702267-0754-408b-9c81-dcf90b344487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d93f0a7-db57-4001-9cb7-f05e31a520eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d93f0a7-db57-4001-9cb7-f05e31a520eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928056944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d01c774-5464-4843-abe8-a6623a2eda4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e9c45beab64c5094c2416ab55013cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:15Z,use_quota=True,user_id='5a796cf71bfd43d681bf1c12be87f7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ee8b4-ae06-4941-907c-7048b172c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ee8b4-ae06-4941-907c-7048b172c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a869c215-16ec-4e42-abd1-733145d1eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a869c215-16ec-4e42-abd1-733145d1eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d01c774-5464-4843-abe8-a6623a2eda4f', 'volume_name': 'volume-8d01c774-5464-4843-abe8-a6623a2eda4f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5755c35-b041-4bcd-af64-2ff2e9133a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5755c35-b041-4bcd-af64-2ff2e9133a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bef416-f2c9-47c3-9589-4c2935320b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Volume 8d01c774-5464-4843-abe8-a6623a2eda4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d01c774-5464-4843-abe8-a6623a2eda4f', 'volume_size': 1} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928056944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d01c774-5464-4843-abe8-a6623a2eda4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e9c45beab64c5094c2416ab55013cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:15Z,use_quota=True,user_id='5a796cf71bfd43d681bf1c12be87f7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Creating volume 8d01c774-5464-4843-abe8-a6623a2eda4f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:14 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f 1073741824 Apr 02 19:55:14 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:15 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f 1073741824" returned: 0 in 0.737s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:15 devstack sudo[84043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f Apr 02 19:55:15 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:16 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f" returned: 0 in 0.461s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04bef416-f2c9-47c3-9589-4c2935320b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d01c774-5464-4843-abe8-a6623a2eda4f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899571b-5a6a-475d-aa06-aca1f6e750b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:16 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Volume volume-8d01c774-5464-4843-abe8-a6623a2eda4f (8d01c774-5464-4843-abe8-a6623a2eda4f): created successfully Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899571b-5a6a-475d-aa06-aca1f6e750b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Flow 'volume_create_manager' (99702267-0754-408b-9c81-dcf90b344487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-99532c6d-ac09-434a-a4a6-36e5b78f5c7d tempest-VolumesServicesTestJSON-1324337147 None] Created volume successfully. Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Acquiring lock "cinder-8d01c774-5464-4843-abe8-a6623a2eda4f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "cinder-8d01c774-5464-4843-abe8-a6623a2eda4f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Acquiring lock "cinder-quobyte-8d01c774-5464-4843-abe8-a6623a2eda4f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "cinder-quobyte-8d01c774-5464-4843-abe8-a6623a2eda4f" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[22061bfd-368c-4e79-a845-f982d675995a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:17 devstack sudo[84100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f Apr 02 19:55:17 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:18 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f" returned: 0 in 1.338s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:18 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f Apr 02 19:55:18 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Acquiring lock "cinder-066f78c1-7d32-4168-bdca-ccccf5377b1e-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "cinder-066f78c1-7d32-4168-bdca-ccccf5377b1e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Acquiring lock "cinder-quobyte-066f78c1-7d32-4168-bdca-ccccf5377b1e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "cinder-quobyte-066f78c1-7d32-4168-bdca-ccccf5377b1e" acquired by "delete_volume" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd9953-ae31-4a6d-b1ce-2acc0d034f82]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:19 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d01c774-5464-4843-abe8-a6623a2eda4f" returned: 0 in 1.062s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "cinder-quobyte-8d01c774-5464-4843-abe8-a6623a2eda4f" released by "delete_volume" :: held 2.446s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Created reservations ['99590389-68f9-446f-bad6-abe147c81092', '079d4752-bc4a-4893-96bc-8ef5d51931b0', '118a85dc-cb9a-4078-88a6-9243b3795097', '6ec40711-02dd-4e54-8347-798ba9e2e052'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:20 devstack sudo[84123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e Apr 02 19:55:20 devstack sudo[84123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:20 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:20 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:21 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 1.312s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:21 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:21 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Deleted volume successfully. Apr 02 19:55:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cd7667e-587f-4121-bcfd-d0a1f1fb9a98 tempest-VolumesServicesTestJSON-1324337147 None] Lock "cinder-8d01c774-5464-4843-abe8-a6623a2eda4f-delete_volume" released by "delete_volume" :: held 4.166s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:21 devstack sudo[84123]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e" returned: 0 in 1.752s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:21 devstack sudo[84177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e Apr 02 19:55:21 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:22 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-066f78c1-7d32-4168-bdca-ccccf5377b1e" returned: 0 in 0.775s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "cinder-quobyte-066f78c1-7d32-4168-bdca-ccccf5377b1e" released by "delete_volume" :: held 2.574s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Created reservations ['9814a994-cf0b-4f42-96ed-374030802d12', 'b53a651a-b7ab-4f96-b7c8-69e07f2fbe42', '812d0623-b4df-48ed-b0c0-b1e940d5057c', 'dc5c7004-b5aa-4bea-9986-8d03c1d20618'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:22 devstack sudo[84181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:22 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:24 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 1.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Deleted volume successfully. Apr 02 19:55:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2057f37d-f1c0-49c0-9d9b-ed2db92925ae tempest-ServerRescueNegativeTestJSON-1847754744 None] Lock "cinder-066f78c1-7d32-4168-bdca-ccccf5377b1e-delete_volume" released by "delete_volume" :: held 4.390s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Flow 'volume_create_manager' (6c1a84bf-8c9f-4c65-b7d8-2c97088d7f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615538f8-7e81-4f5d-bf58-eed731870a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615538f8-7e81-4f5d-bf58-eed731870a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-871782380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eadf3f-7f77-47c1-99b4-39a1f6f90102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff76e3e7ffb403daf865f10d34826f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:33Z,use_quota=True,user_id='5847a618ff394a4ca7295ecb86a1aabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b5fcbd-1229-4c72-b7cc-8730a667bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b5fcbd-1229-4c72-b7cc-8730a667bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83337bb7-9db0-4c62-8bde-6fda7b3d3c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83337bb7-9db0-4c62-8bde-6fda7b3d3c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77eadf3f-7f77-47c1-99b4-39a1f6f90102', 'volume_name': 'volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e53339-4a05-4ec7-be6e-f4a6c6fe662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e53339-4a05-4ec7-be6e-f4a6c6fe662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253fcb96-8a39-4af2-99c9-630c25f12c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:33 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Volume 77eadf3f-7f77-47c1-99b4-39a1f6f90102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102', 'volume_size': 1} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-871782380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eadf3f-7f77-47c1-99b4-39a1f6f90102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff76e3e7ffb403daf865f10d34826f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:33Z,use_quota=True,user_id='5847a618ff394a4ca7295ecb86a1aabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Creating volume 77eadf3f-7f77-47c1-99b4-39a1f6f90102 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:33 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:33 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 1073741824 Apr 02 19:55:33 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (80143cde-16cd-4c02-aff6-fae9f345b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee353989-797d-4b6f-a8cd-234733f48e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee353989-797d-4b6f-a8cd-234733f48e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-692267469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d229d8d1-f122-45a7-a7cb-8931a46f824a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:34Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c84a3f-f32d-48e5-ae9f-d62c1b015bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c84a3f-f32d-48e5-ae9f-d62c1b015bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4338cda-c816-454c-b8d6-30f87aa2b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4338cda-c816-454c-b8d6-30f87aa2b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd229d8d1-f122-45a7-a7cb-8931a46f824a', 'volume_name': 'volume-d229d8d1-f122-45a7-a7cb-8931a46f824a', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b59863-d9d7-4a21-85ad-6d1dc9fd1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b59863-d9d7-4a21-85ad-6d1dc9fd1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff0edf6-d30e-46f9-af88-b3a38bbd7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Volume d229d8d1-f122-45a7-a7cb-8931a46f824a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d229d8d1-f122-45a7-a7cb-8931a46f824a', 'volume_size': 1} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 1073741824" returned: 0 in 0.623s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:34 devstack sudo[84287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 Apr 02 19:55:34 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:34 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102" returned: 0 in 0.506s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-692267469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d229d8d1-f122-45a7-a7cb-8931a46f824a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:34Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Creating volume d229d8d1-f122-45a7-a7cb-8931a46f824a {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:34 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253fcb96-8a39-4af2-99c9-630c25f12c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a 1073741824 Apr 02 19:55:34 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4c3fd7-3840-4953-ba63-dd7317034ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Volume volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 (77eadf3f-7f77-47c1-99b4-39a1f6f90102): created successfully Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4c3fd7-3840-4953-ba63-dd7317034ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Flow 'volume_create_manager' (6c1a84bf-8c9f-4c65-b7d8-2c97088d7f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8e8ce41b-92e6-4040-9b63-522a52c9963a tempest-DeleteServersTestJSON-86196157 None] Created volume successfully. Apr 02 19:55:35 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a 1073741824" returned: 0 in 0.556s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:35 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a Apr 02 19:55:35 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:35 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a" returned: 0 in 0.509s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff0edf6-d30e-46f9-af88-b3a38bbd7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d229d8d1-f122-45a7-a7cb-8931a46f824a', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e5b7c2-d2ed-4f7a-875f-a1aa00e59b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:35 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Volume volume-d229d8d1-f122-45a7-a7cb-8931a46f824a (d229d8d1-f122-45a7-a7cb-8931a46f824a): created successfully Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e5b7c2-d2ed-4f7a-875f-a1aa00e59b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (80143cde-16cd-4c02-aff6-fae9f345b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:35 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2d4e0fe5-6f68-4963-b968-770e47bd1825 tempest-VolumesListAdminTestJSON-1956016578 None] Created volume successfully. Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (0d1f1b22-7d80-475f-9bb2-717c639b16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f2a1c-7233-42d3-8ba8-1671aea42e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f2a1c-7233-42d3-8ba8-1671aea42e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886694800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022191dc-913e-4242-88f4-c8483217fd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:37Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27026747-8099-4918-95b5-cafe708d1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27026747-8099-4918-95b5-cafe708d1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4829d52f-5e90-470e-86a8-e63d3ef71d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4829d52f-5e90-470e-86a8-e63d3ef71d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022191dc-913e-4242-88f4-c8483217fd12', 'volume_name': 'volume-022191dc-913e-4242-88f4-c8483217fd12', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9409fecd-76f7-4a5d-a775-5e94d112bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9409fecd-76f7-4a5d-a775-5e94d112bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb9ae87-7ec5-43be-9a37-2fd6419f2f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:36 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Volume 022191dc-913e-4242-88f4-c8483217fd12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022191dc-913e-4242-88f4-c8483217fd12', 'volume_size': 1} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886694800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022191dc-913e-4242-88f4-c8483217fd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:37Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Creating volume 022191dc-913e-4242-88f4-c8483217fd12 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:36 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:36 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 1073741824 Apr 02 19:55:36 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:37 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 1073741824" returned: 0 in 0.718s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:37 devstack sudo[84317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 Apr 02 19:55:37 devstack sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:38 devstack sudo[84317]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12" returned: 0 in 0.871s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb9ae87-7ec5-43be-9a37-2fd6419f2f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022191dc-913e-4242-88f4-c8483217fd12', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8fb5e5-39c7-4137-8617-e0b6708aac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:38 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Volume volume-022191dc-913e-4242-88f4-c8483217fd12 (022191dc-913e-4242-88f4-c8483217fd12): created successfully Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8fb5e5-39c7-4137-8617-e0b6708aac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (0d1f1b22-7d80-475f-9bb2-717c639b16be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2250f3f2-c85f-4b9f-9d7a-c2ae4c84b76f tempest-VolumesListAdminTestJSON-1956016578 None] Created volume successfully. Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (ff6e3187-c0e1-405e-83bc-7c09cb7150dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edc1d88-dcad-4d39-b1ff-dc76cdc9445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edc1d88-dcad-4d39-b1ff-dc76cdc9445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-241985196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae8886a-a54d-4950-9f10-76107efea042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:39Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11a23d8-a435-4ad8-8e6d-4ba490c03dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11a23d8-a435-4ad8-8e6d-4ba490c03dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a22038-d95b-461c-afa6-43d6d908280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a22038-d95b-461c-afa6-43d6d908280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae8886a-a54d-4950-9f10-76107efea042', 'volume_name': 'volume-6ae8886a-a54d-4950-9f10-76107efea042', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b50fbdd-2ff5-4755-819d-5938b8d527ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b50fbdd-2ff5-4755-819d-5938b8d527ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fceeb8e-4c33-4ef6-9800-be9b2ac93679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:39 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Volume 6ae8886a-a54d-4950-9f10-76107efea042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae8886a-a54d-4950-9f10-76107efea042', 'volume_size': 1} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-241985196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae8886a-a54d-4950-9f10-76107efea042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e16b33b996492c86f3d61bb5d8f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:39Z,use_quota=True,user_id='f5134c9ce61c4c9c82bb5a1e3aa4d882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Creating volume 6ae8886a-a54d-4950-9f10-76107efea042 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:39 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:39 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 1073741824 Apr 02 19:55:39 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:40 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 1073741824" returned: 0 in 1.160s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:40 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 Apr 02 19:55:40 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:40 devstack cinder-volume[82597]: WARNING py.warnings [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 02 19:55:40 devstack cinder-volume[82597]: .first() Apr 02 19:55:40 devstack cinder-volume[82597]: Apr 02 19:55:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:41 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042" returned: 0 in 0.700s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.386s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fceeb8e-4c33-4ef6-9800-be9b2ac93679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae8886a-a54d-4950-9f10-76107efea042', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecef33e-65b0-4f97-af86-64752737d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa666da7-3f1d-48b9-a1c3-d6dbedf543aa]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Volume volume-6ae8886a-a54d-4950-9f10-76107efea042 (6ae8886a-a54d-4950-9f10-76107efea042): created successfully Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecef33e-65b0-4f97-af86-64752737d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Flow 'volume_create_manager' (ff6e3187-c0e1-405e-83bc-7c09cb7150dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-76fa4149-7e57-4cbb-b019-5da62fef0666 tempest-VolumesListAdminTestJSON-1956016578 None] Created volume successfully. Apr 02 19:55:41 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 Apr 02 19:55:41 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:41 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102" returned: 0 in 0.591s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.615s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b', 'name': 'volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0916cb5-6e9f-4f27-bac6-75eae2d9b74c', 'enforce_multipath': True} {{(pid=82597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 19:55:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-9123715d-e3f5-468a-be50-a9255a219511 req-ecc54a63-947e-4767-815e-a34473d0b249 tempest-DeleteServersTestJSON-86196157 None] attachment_update completed successfully. Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Flow 'volume_create_manager' (fed1d1dd-0d8d-48b8-9742-75016d3a93aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2c1ee1-bfa1-4c64-845a-80cd92a84f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2c1ee1-bfa1-4c64-845a-80cd92a84f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbb86a3-ff18-4382-9506-f34fddcf4aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf1c6288664cb6a3b4f087db8e9397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:43Z,use_quota=True,user_id='2a0f2525065c4da0937c8899ec48ca5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819ffec0-47b6-45e3-aa99-e75acc093c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819ffec0-47b6-45e3-aa99-e75acc093c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea01ec3d-b7dc-4f90-8cb5-043a4db97cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea01ec3d-b7dc-4f90-8cb5-043a4db97cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbb86a3-ff18-4382-9506-f34fddcf4aee', 'volume_name': 'volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987a03f3-a352-45d5-86a9-977b578081a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987a03f3-a352-45d5-86a9-977b578081a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4eacd8-c1ba-46b8-a21e-3aef4f138c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Volume 5cbb86a3-ff18-4382-9506-f34fddcf4aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee', 'volume_size': 1} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbb86a3-ff18-4382-9506-f34fddcf4aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaf1c6288664cb6a3b4f087db8e9397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:43Z,use_quota=True,user_id='2a0f2525065c4da0937c8899ec48ca5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Creating volume 5cbb86a3-ff18-4382-9506-f34fddcf4aee {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:43 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:43 devstack sudo[84684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee 1073741824 Apr 02 19:55:43 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Flow 'volume_create_manager' (c642ea2f-644e-4fa2-a0e8-914b496f681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98873adf-af6d-4ced-8dc7-9464afef66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98873adf-af6d-4ced-8dc7-9464afef66cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1289018327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e34244b-32fa-4006-870d-144c9e98e745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3439b7b4be67407bb124f9669c90dc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:44Z,use_quota=True,user_id='6b416bd01c554d8482761366fd06acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bf91c8-2206-46e1-b5f7-2ea14ab46b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bf91c8-2206-46e1-b5f7-2ea14ab46b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d6e484-5228-4c11-b3dd-f77a888a5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d6e484-5228-4c11-b3dd-f77a888a5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e34244b-32fa-4006-870d-144c9e98e745', 'volume_name': 'volume-4e34244b-32fa-4006-870d-144c9e98e745', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac8c9f2-10ff-4058-be4c-0f7fb63912e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac8c9f2-10ff-4058-be4c-0f7fb63912e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92851ae-de46-4678-9188-773c4132eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:43 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Volume 4e34244b-32fa-4006-870d-144c9e98e745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e34244b-32fa-4006-870d-144c9e98e745', 'volume_size': 1} Apr 02 19:55:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:44 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee 1073741824" returned: 0 in 0.719s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:44 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee Apr 02 19:55:44 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:44 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee" returned: 0 in 0.493s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1289018327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e34244b-32fa-4006-870d-144c9e98e745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3439b7b4be67407bb124f9669c90dc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:44Z,use_quota=True,user_id='6b416bd01c554d8482761366fd06acfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Creating volume 4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:44 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4eacd8-c1ba-46b8-a21e-3aef4f138c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f005e7e4-35ca-407f-a83d-38c565d2dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:44 devstack sudo[84748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 1073741824 Apr 02 19:55:44 devstack sudo[84748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:44 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Volume volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee (5cbb86a3-ff18-4382-9506-f34fddcf4aee): created successfully Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f005e7e4-35ca-407f-a83d-38c565d2dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Flow 'volume_create_manager' (fed1d1dd-0d8d-48b8-9742-75016d3a93aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d4866d34-1d19-4021-a99f-f4376492d2bc tempest-VolumesListAdminTestJSON-947762354 None] Created volume successfully. Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Acquiring lock "cinder-5cbb86a3-ff18-4382-9506-f34fddcf4aee-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:45 devstack sudo[84748]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "cinder-5cbb86a3-ff18-4382-9506-f34fddcf4aee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 1073741824" returned: 0 in 0.925s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Acquiring lock "cinder-quobyte-5cbb86a3-ff18-4382-9506-f34fddcf4aee" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "cinder-quobyte-5cbb86a3-ff18-4382-9506-f34fddcf4aee" acquired by "delete_volume" :: waited 0.025s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260cbc1-7230-405e-9a08-90519f29e427]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-6ae8886a-a54d-4950-9f10-76107efea042-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:45 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 Apr 02 19:55:45 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-6ae8886a-a54d-4950-9f10-76107efea042-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-quobyte-6ae8886a-a54d-4950-9f10-76107efea042" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-6ae8886a-a54d-4950-9f10-76107efea042" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[95136d33-e7d1-43a0-84b9-a0bf6543cdda]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:45 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee Apr 02 19:55:45 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:46 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 Apr 02 19:55:46 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:46 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745" returned: 0 in 0.846s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92851ae-de46-4678-9188-773c4132eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e34244b-32fa-4006-870d-144c9e98e745', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b109bce1-344a-42ca-9dae-d4ac493d8e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Volume volume-4e34244b-32fa-4006-870d-144c9e98e745 (4e34244b-32fa-4006-870d-144c9e98e745): created successfully Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b109bce1-344a-42ca-9dae-d4ac493d8e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Flow 'volume_create_manager' (c642ea2f-644e-4fa2-a0e8-914b496f681d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-a979c3e5-c3a9-4fe2-94be-79f70f7a4ce7 req-2e9c3824-4cf2-4d16-8390-5ebd7f3fa29e tempest-VolumesSnapshotsTestJSON-1702544352 None] Created volume successfully. Apr 02 19:55:46 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042" returned: 0 in 0.883s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:46 devstack sudo[84767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042 Apr 02 19:55:46 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:46 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee" returned: 0 in 1.151s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:46 devstack sudo[84769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee Apr 02 19:55:46 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:47 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ae8886a-a54d-4950-9f10-76107efea042" returned: 0 in 0.780s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-6ae8886a-a54d-4950-9f10-76107efea042" released by "delete_volume" :: held 1.694s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:47 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5cbb86a3-ff18-4382-9506-f34fddcf4aee" returned: 0 in 0.707s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "cinder-quobyte-5cbb86a3-ff18-4382-9506-f34fddcf4aee" released by "delete_volume" :: held 1.898s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Created reservations ['c7a4e035-e751-4147-be85-efff0d508443', 'c9a7be08-7127-4af3-be9d-ad760ca6bfa9', '22cbfb68-5f26-458b-9a7c-e40565035f40', '67f117f7-ea25-4b9b-b97e-fb36fb9162c7'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:47 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:47 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Creating offline snapshot e1012e46-1b94-4b90-8f0e-47376163bef9 of volume 4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d9ccf-eeb5-4055-afc1-edfebb074fa0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Created reservations ['fbb62168-43bd-4fbb-8050-60de41d5fe7f', '2f81d688-8553-419b-93e6-dcff8151e3c3', '1afa6f0e-f980-42ec-9cb3-e4fddbd42a64', 'ed5e337a-1276-48cc-92c8-f1452fcd82a3'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:47 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 Apr 02 19:55:47 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:48 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:48 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-022191dc-913e-4242-88f4-c8483217fd12-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-022191dc-913e-4242-88f4-c8483217fd12-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-quobyte-022191dc-913e-4242-88f4-c8483217fd12" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-022191dc-913e-4242-88f4-c8483217fd12" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e49850-32b5-41c6-b69f-07d642347115]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:48 devstack sudo[84790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 Apr 02 19:55:48 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:48 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.810s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Deleted volume successfully. Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-31d73420-0107-43d8-8322-ee42839eaaa1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-6ae8886a-a54d-4950-9f10-76107efea042-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:48 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.614s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Deleted volume successfully. Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-aabcc4e1-4a98-4a74-8ba7-e9307b332868 tempest-VolumesListAdminTestJSON-947762354 None] Lock "cinder-5cbb86a3-ff18-4382-9506-f34fddcf4aee-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:48 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745" returned: 0 in 1.122s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:48 devstack sudo[84845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 1G Apr 02 19:55:48 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:49 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12" returned: 0 in 0.894s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:49 devstack sudo[84850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12 Apr 02 19:55:49 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:49 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 1G" returned: 0 in 0.556s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e34244b-32fa-4006-870d-144c9e98e745 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:49 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-022191dc-913e-4242-88f4-c8483217fd12" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:49 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e34244b-32fa-4006-870d-144c9e98e745 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-022191dc-913e-4242-88f4-c8483217fd12" released by "delete_volume" :: held 1.318s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:49 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Created reservations ['57ce4ee4-9435-495f-a6d2-152a93a02e67', '30cf87d7-5f0c-47d2-924a-1c58be557b05', '84e6a252-bfd7-4f18-84cf-e3994d789052', 'd9bee056-68e8-46cf-8f59-f75048854435'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:49 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:49 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:49 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e34244b-32fa-4006-870d-144c9e98e745 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9" returned: 0 in 0.532s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:49 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 is being set with open permissions: ugo+rw Apr 02 19:55:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:50 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 Apr 02 19:55:50 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:50 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Deleted volume successfully. Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2deb7e27-08de-41ff-8d12-489bc9c3a29a tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-022191dc-913e-4242-88f4-c8483217fd12-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-d229d8d1-f122-45a7-a7cb-8931a46f824a-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-d229d8d1-f122-45a7-a7cb-8931a46f824a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "cinder-quobyte-d229d8d1-f122-45a7-a7cb-8931a46f824a" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-d229d8d1-f122-45a7-a7cb-8931a46f824a" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d72ef-895d-493d-b93d-2cf84c2b2cd5]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:50 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:50 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a Apr 02 19:55:50 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:50 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info Apr 02 19:55:50 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-09a2ceaa-8639-4706-8ca5-56a15a216738 req-f4ab6506-a3ea-4547-af2e-0f542c7a3fe0 tempest-DeleteServersTestJSON-86196157 None] Terminate volume connection completed successfully. Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-09a2ceaa-8639-4706-8ca5-56a15a216738 req-f4ab6506-a3ea-4547-af2e-0f542c7a3fe0 tempest-DeleteServersTestJSON-86196157 None] Deleting attachment a0916cb5-6e9f-4f27-bac6-75eae2d9b74c. {{(pid=82597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 19:55:50 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info" returned: 0 in 0.420s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:50 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info is being set with open permissions: ugo+rw Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:50 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:50 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info Apr 02 19:55:50 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:50 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a Apr 02 19:55:50 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:51 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.info" returned: 0 in 0.410s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-e81e9724-2926-40eb-90e7-497e2c3f5a7c req-ae0fcdd6-4c71-4b02-a088-655a86c5c566 tempest-VolumesSnapshotsTestJSON-1702544352 None] Create snapshot completed successfully Apr 02 19:55:51 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d229d8d1-f122-45a7-a7cb-8931a46f824a" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-quobyte-d229d8d1-f122-45a7-a7cb-8931a46f824a" released by "delete_volume" :: held 0.956s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Created reservations ['64d7dc82-94f1-4230-86d0-855ba6d6b91b', '1a3a76b9-57e1-4a48-b935-35678c3d1b2f', 'ddaa0814-97eb-40f1-bcaf-e7f278e1206e', '4ce4b1db-ef44-4a82-b6f0-5c37707191ff'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:51 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:51 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:51 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.435s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Deleted volume successfully. Apr 02 19:55:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95c996f0-6142-44db-bd9b-2bccd984f9c1 tempest-VolumesListAdminTestJSON-1956016578 None] Lock "cinder-d229d8d1-f122-45a7-a7cb-8931a46f824a-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "cinder-e1012e46-1b94-4b90-8f0e-47376163bef9-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-e1012e46-1b94-4b90-8f0e-47376163bef9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "cinder-quobyte-e1012e46-1b94-4b90-8f0e-47376163bef9" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-e1012e46-1b94-4b90-8f0e-47376163bef9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Deleting offline snapshot e1012e46-1b94-4b90-8f0e-47376163bef9 of volume 4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] snapshot_file for this snap is: volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160fa6f-6372-4a1c-b839-84cb942dc793]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:52 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 Apr 02 19:55:52 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:52 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e34244b-32fa-4006-870d-144c9e98e745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373ab95-ef85-42d6-a96a-8ffc4473a248]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:52 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 Apr 02 19:55:52 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:53 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745" returned: 0 in 0.515s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:53 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 Apr 02 19:55:53 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:53 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:53 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9 Apr 02 19:55:53 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:54 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745.e1012e46-1b94-4b90-8f0e-47376163bef9" returned: 0 in 0.420s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-e1012e46-1b94-4b90-8f0e-47376163bef9" released by "_delete_snapshot" :: held 2.007s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" released by "delete_snapshot" :: held 2.021s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.quota [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Created reservations ['ce32e98a-7599-42b9-9c87-d4bca3e20fcb', '9070af3b-9984-424d-b095-e413e895e40b', 'f56012b0-ceea-42eb-a37b-f7fa60f0cfb7', 'd1bdaec5-fc94-46d7-b866-7cec8185088f'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Delete snapshot completed successfully. Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-a5b14570-db5f-479f-8830-9ac2b2548602 req-46d5058b-4c1a-4cf8-b3ad-0900b2d1f1fe tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-e1012e46-1b94-4b90-8f0e-47376163bef9-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "cinder-4e34244b-32fa-4006-870d-144c9e98e745-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-4e34244b-32fa-4006-870d-144c9e98e745-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea26d1-cf73-44b0-a2c5-ec74c37a018e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:54 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 Apr 02 19:55:54 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:54 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745" returned: 0 in 0.587s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:54 devstack sudo[84918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745 Apr 02 19:55:54 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:55 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4e34244b-32fa-4006-870d-144c9e98e745" returned: 0 in 0.601s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-quobyte-4e34244b-32fa-4006-870d-144c9e98e745" released by "delete_volume" :: held 1.229s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG cinder.quota [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Created reservations ['dfd4a276-9c00-482a-96f1-8a4be9995719', '6e142d57-4727-4ba6-9fae-a86b5b0519ec', 'bd31e0b1-27f0-4a02-8be1-9993481f9d9c', '98cd1fb0-f660-4d93-82f3-0ea4bc2700d3'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:55 devstack sudo[84921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:55 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:56 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.544s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:56 devstack cinder-volume[82597]: DEBUG cinder.manager [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Deleted volume successfully. Apr 02 19:55:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-9af9531b-d691-4f87-9cae-da9d4e9904b6 req-7b1f60b8-a37f-4c5d-b77e-ed130027597d tempest-VolumesSnapshotsTestJSON-1702544352 None] Lock "cinder-4e34244b-32fa-4006-870d-144c9e98e745-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "cinder-77eadf3f-7f77-47c1-99b4-39a1f6f90102-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "cinder-77eadf3f-7f77-47c1-99b4-39a1f6f90102-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "cinder-quobyte-77eadf3f-7f77-47c1-99b4-39a1f6f90102" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "cinder-quobyte-77eadf3f-7f77-47c1-99b4-39a1f6f90102" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e7b99-5426-442c-8b6c-030a93ae3535]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:57 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 Apr 02 19:55:57 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:57 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102" returned: 0 in 0.622s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:57 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102 Apr 02 19:55:57 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:58 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-77eadf3f-7f77-47c1-99b4-39a1f6f90102" returned: 0 in 0.593s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "cinder-quobyte-77eadf3f-7f77-47c1-99b4-39a1f6f90102" released by "delete_volume" :: held 1.244s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Created reservations ['75fe7e26-fdc9-44c0-b113-35b24731cf9c', 'b6a44fea-0149-4ecd-8e02-a5f83eb80a6d', 'e778fb6c-2bbc-41c2-8fba-cf138f4f5ff9', '01b61f76-c135-4d9b-995e-b9f2d5f8cb21'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:58 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:55:58 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:58 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.510s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:55:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Deleted volume successfully. Apr 02 19:55:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b23cd0e2-6811-4162-a839-8736be466fd5 tempest-DeleteServersTestJSON-86196157 None] Lock "cinder-77eadf3f-7f77-47c1-99b4-39a1f6f90102-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Flow 'volume_create_manager' (f8ea0e04-a6d2-47e6-bd0b-fcd5d3325547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af39552-18e5-4519-8f90-50c11556ea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af39552-18e5-4519-8f90-50c11556ea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1278357195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc415f3e-3bce-4de3-be3d-0c47197a7969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f7317a7b27a04ad7be13d2c995302258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:59Z,use_quota=True,user_id='ac646bb2f54d4e80a9511a0970cd7cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eae4034-32f8-4756-be9a-c8a24d483e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eae4034-32f8-4756-be9a-c8a24d483e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d406d791-ed8f-4778-a7c1-bedd6246dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d406d791-ed8f-4778-a7c1-bedd6246dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc415f3e-3bce-4de3-be3d-0c47197a7969', 'volume_name': 'volume-fc415f3e-3bce-4de3-be3d-0c47197a7969', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91e931e-bfe6-44bc-9e3b-e6565ea2f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91e931e-bfe6-44bc-9e3b-e6565ea2f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2960518d-f58c-4036-b28a-eb5cc6c8591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:55:59 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Volume fc415f3e-3bce-4de3-be3d-0c47197a7969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc415f3e-3bce-4de3-be3d-0c47197a7969', 'volume_size': 1} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1278357195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc415f3e-3bce-4de3-be3d-0c47197a7969,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f7317a7b27a04ad7be13d2c995302258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:55:59Z,use_quota=True,user_id='ac646bb2f54d4e80a9511a0970cd7cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Creating volume fc415f3e-3bce-4de3-be3d-0c47197a7969 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:55:59 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:55:59 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 1073741824 Apr 02 19:55:59 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:55:59 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 1073741824" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:55:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:00 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 Apr 02 19:56:00 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:00 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969" returned: 0 in 0.407s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2960518d-f58c-4036-b28a-eb5cc6c8591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc415f3e-3bce-4de3-be3d-0c47197a7969', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773969fc-f6f6-42a0-9cb4-c5891a87bc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:00 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Volume volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 (fc415f3e-3bce-4de3-be3d-0c47197a7969): created successfully Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773969fc-f6f6-42a0-9cb4-c5891a87bc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:00 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Flow 'volume_create_manager' (f8ea0e04-a6d2-47e6-bd0b-fcd5d3325547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-e7253b6a-4078-4b14-acea-07edd052c8a9 req-c5b3cf29-ce6a-4ed7-adcd-052eb490ad74 tempest-VolumesGetTestJSON-489125370 None] Created volume successfully. Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Acquiring lock "cinder-fc415f3e-3bce-4de3-be3d-0c47197a7969-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "cinder-fc415f3e-3bce-4de3-be3d-0c47197a7969-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Acquiring lock "cinder-quobyte-fc415f3e-3bce-4de3-be3d-0c47197a7969" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "cinder-quobyte-fc415f3e-3bce-4de3-be3d-0c47197a7969" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245d939-de1f-40c0-ad3e-ed8f123f5990]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:01 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 Apr 02 19:56:01 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:02 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969" returned: 0 in 0.535s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:02 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969 Apr 02 19:56:02 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:02 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-fc415f3e-3bce-4de3-be3d-0c47197a7969" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "cinder-quobyte-fc415f3e-3bce-4de3-be3d-0c47197a7969" released by "delete_volume" :: held 1.009s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG cinder.quota [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Created reservations ['4c8d95c7-ffb4-488a-a3c8-76edeb259b18', '27b94146-cdff-4673-a901-cdf343db4397', '04a9754d-2e41-4bd3-ad94-b3708fa45f69', '8f669e40-aef5-423d-a647-a55208fd7ff2'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:02 devstack sudo[84998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:02 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:03 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:03 devstack cinder-volume[82597]: DEBUG cinder.manager [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Deleted volume successfully. Apr 02 19:56:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-4137894e-6aad-4e38-bf0b-5ad74c39daa4 req-a0f62ee4-a91b-40e7-8f50-1f9ecb5ca083 tempest-VolumesGetTestJSON-489125370 None] Lock "cinder-fc415f3e-3bce-4de3-be3d-0c47197a7969-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (a2cff4da-b08a-467a-83cd-a8e620349f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686d89b0-fb3a-4c59-bd9e-4ca82aec72c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686d89b0-fb3a-4c59-bd9e-4ca82aec72c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853439092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab8564-ac95-4d6d-8f31-0e15cf650b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:04Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b297931-2d5a-44dc-ae77-1ebd99f7f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b297931-2d5a-44dc-ae77-1ebd99f7f056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc491f-802c-4d4e-9753-8cfa6f58eaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decc491f-802c-4d4e-9753-8cfa6f58eaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ab8564-ac95-4d6d-8f31-0e15cf650b7f', 'volume_name': 'volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6d7dd9-9f51-4ffa-a7c6-2399a11caaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6d7dd9-9f51-4ffa-a7c6-2399a11caaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105d1b7e-985f-464b-a834-05c20b85116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:04 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Volume b5ab8564-ac95-4d6d-8f31-0e15cf650b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f', 'volume_size': 1} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1853439092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab8564-ac95-4d6d-8f31-0e15cf650b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:04Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Creating volume b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:04 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:04 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f 1073741824 Apr 02 19:56:04 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:05 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f 1073741824" returned: 0 in 0.882s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:05 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f Apr 02 19:56:05 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:05 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" returned: 0 in 0.594s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105d1b7e-985f-464b-a834-05c20b85116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f20cc-9ad0-4241-bc93-dd5246a5ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:05 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Volume volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f (b5ab8564-ac95-4d6d-8f31-0e15cf650b7f): created successfully Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186f20cc-9ad0-4241-bc93-dd5246a5ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (a2cff4da-b08a-467a-83cd-a8e620349f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:05 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-04a33f32-553e-43b5-a225-6b9bc6569b0c tempest-VolumesSnapshotTestJSON-1706075825 None] Created volume successfully. Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Creating offline snapshot 4528e5d6-3f64-466a-8f7c-32b0ae9927c8 of volume b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3727b74e-174d-4677-8654-c8f09a59528f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:06 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:06 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:06 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f Apr 02 19:56:06 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (8adef2ed-ed7d-4344-b083-765c8f241abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00f1fce-cfab-4c42-a800-8280fb26e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00f1fce-cfab-4c42-a800-8280fb26e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944179001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54def31-acdc-440f-93c5-2129b1c7bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:07Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccb16d9-577d-4b6d-b293-3da7d096a2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccb16d9-577d-4b6d-b293-3da7d096a2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f340a08a-5076-43a5-a8c4-1720a94f4118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f340a08a-5076-43a5-a8c4-1720a94f4118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54def31-acdc-440f-93c5-2129b1c7bf71', 'volume_name': 'volume-c54def31-acdc-440f-93c5-2129b1c7bf71', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5975bee9-48f5-4c60-9cbd-e8ecfd4b1bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5975bee9-48f5-4c60-9cbd-e8ecfd4b1bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403933fc-b183-441e-b73d-45767544654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Volume c54def31-acdc-440f-93c5-2129b1c7bf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54def31-acdc-440f-93c5-2129b1c7bf71', 'volume_size': 1} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:07 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.725s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (6b68fd7a-f04b-4b9c-a7fc-75b760a2a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7314f2b3-86cd-4fcb-8b08-b778682e19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7314f2b3-86cd-4fcb-8b08-b778682e19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1217680748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fcb8d4-c194-4737-887b-df03a2bb9fa2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:08Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411e4a2-f3af-424f-9d1d-f2b1f6d7bf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2411e4a2-f3af-424f-9d1d-f2b1f6d7bf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429573ed-e138-46f0-ac64-593ba24de662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429573ed-e138-46f0-ac64-593ba24de662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fcb8d4-c194-4737-887b-df03a2bb9fa2', 'volume_name': 'volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8d1479-cb1f-46db-9b6e-6bb949e6041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8d1479-cb1f-46db-9b6e-6bb949e6041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a275d711-a9bb-47cb-a890-630dc5f471ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Volume e9fcb8d4-c194-4737-887b-df03a2bb9fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2', 'volume_size': 1} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" returned: 0 in 1.020s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:07 devstack sudo[85025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 1G Apr 02 19:56:07 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:08 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 1G" returned: 0 in 0.558s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:08 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 Apr 02 19:56:08 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:08 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8" returned: 0 in 0.465s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:08 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 is being set with open permissions: ugo+rw Apr 02 19:56:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:08 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 Apr 02 19:56:08 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:09 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:09 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info Apr 02 19:56:09 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:09 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info" returned: 0 in 0.418s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:09 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info is being set with open permissions: ugo+rw Apr 02 19:56:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:09 devstack sudo[85041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info Apr 02 19:56:09 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:10 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.info" returned: 0 in 0.412s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.411s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944179001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54def31-acdc-440f-93c5-2129b1c7bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:07Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Creating volume c54def31-acdc-440f-93c5-2129b1c7bf71 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:10 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:10 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 1073741824 Apr 02 19:56:10 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:10 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-09ae378f-9a1b-42a8-a7c1-b5aa768b83ac tempest-VolumesSnapshotTestJSON-1706075825 None] Create snapshot completed successfully Apr 02 19:56:10 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 1073741824" returned: 0 in 0.600s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:10 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 Apr 02 19:56:10 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-4528e5d6-3f64-466a-8f7c-32b0ae9927c8-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-4528e5d6-3f64-466a-8f7c-32b0ae9927c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-4528e5d6-3f64-466a-8f7c-32b0ae9927c8" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-4528e5d6-3f64-466a-8f7c-32b0ae9927c8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Deleting offline snapshot 4528e5d6-3f64-466a-8f7c-32b0ae9927c8 of volume b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] snapshot_file for this snap is: volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa94c96-4bf0-463d-bdf4-c26153897b89]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:11 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 Apr 02 19:56:11 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:11 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71" returned: 0 in 0.592s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.566s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1217680748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fcb8d4-c194-4737-887b-df03a2bb9fa2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:08Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Creating volume e9fcb8d4-c194-4737-887b-df03a2bb9fa2 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:11 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403933fc-b183-441e-b73d-45767544654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54def31-acdc-440f-93c5-2129b1c7bf71', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362ad613-10f5-4892-8ba9-599cfa4c0877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:11 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 1073741824 Apr 02 19:56:11 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Volume volume-c54def31-acdc-440f-93c5-2129b1c7bf71 (c54def31-acdc-440f-93c5-2129b1c7bf71): created successfully Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362ad613-10f5-4892-8ba9-599cfa4c0877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (8adef2ed-ed7d-4344-b083-765c8f241abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-919e8f30-a853-4a78-a9b2-b4018946b1ac tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:11 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8" returned: 0 in 0.557s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187aceb-89a9-4067-adc7-d071ceeb2d2c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:11 devstack sudo[85061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f Apr 02 19:56:11 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:12 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 1073741824" returned: 0 in 1.020s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:12 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 Apr 02 19:56:12 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b6ce1fc0-38c3-405e-a251-90332ec4a22b tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71" by "attach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b6ce1fc0-38c3-405e-a251-90332ec4a22b tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71" acquired by "attach_volume" :: waited 0.024s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b6ce1fc0-38c3-405e-a251-90332ec4a22b tempest-VolumesActionsTest-1512179731 None] Attaching volume c54def31-acdc-440f-93c5-2129b1c7bf71 to instance d2a10be1-1283-4d9f-b784-260058de13ea at mountpoint /dev/vdb on host None. Apr 02 19:56:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b6ce1fc0-38c3-405e-a251-90332ec4a22b tempest-VolumesActionsTest-1512179731 None] Attach volume completed successfully. Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b6ce1fc0-38c3-405e-a251-90332ec4a22b tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71" released by "attach_volume" :: held 0.127s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:12 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" returned: 0 in 1.125s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:12 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 Apr 02 19:56:12 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:13 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" returned: 0 in 0.657s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a275d711-a9bb-47cb-a890-630dc5f471ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ed1b02-99a0-4dbd-bb03-d7f27a1d1aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:13 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Volume volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 (e9fcb8d4-c194-4737-887b-df03a2bb9fa2): created successfully Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ed1b02-99a0-4dbd-bb03-d7f27a1d1aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (6b68fd7a-f04b-4b9c-a7fc-75b760a2a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-313de72a-db41-40cf-847b-b392d6608eb5 tempest-VolumesTestJSON-1260983935 None] Created volume successfully. Apr 02 19:56:13 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8" returned: 0 in 0.660s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:13 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8 Apr 02 19:56:13 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Terminate volume connection completed successfully. Apr 02 19:56:13 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f.4528e5d6-3f64-466a-8f7c-32b0ae9927c8" returned: 0 in 0.469s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-4528e5d6-3f64-466a-8f7c-32b0ae9927c8" released by "_delete_snapshot" :: held 2.869s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" released by "delete_snapshot" :: held 2.882s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=95,cinder:UPDATE=124,cinder:INSERT=21,cinder:DELETE=10 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:56:13 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['b66bfdf8-9627-4b01-bbdc-152494209d04', 'dd611a11-ad5c-4af2-8cd1-a992b6f585d8', 'c5c28371-1375-4f2e-87e2-deaff7d05605', '9f5ed2bb-4bea-4737-a974-03cf320bba68'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Delete snapshot completed successfully. Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ae5a5963-c91e-414c-a99e-c31cb9203a4c tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-4528e5d6-3f64-466a-8f7c-32b0ae9927c8-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" by "detach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Detaching volume c54def31-acdc-440f-93c5-2129b1c7bf71 from instance d2a10be1-1283-4d9f-b784-260058de13ea. Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=109,cinder:UPDATE=114,cinder:INSERT=34,cinder:DELETE=12 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Detach volume completed successfully. Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9bad6317-1db9-40e9-bf0a-baeaf3c38734 tempest-VolumesActionsTest-274129931 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (6cb9de78-53e2-45df-a04d-b95f1a3e88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f78f9a6-2685-4248-b02c-71a471e8e0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f78f9a6-2685-4248-b02c-71a471e8e0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2005389510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f872097-8778-4c97-94c0-bb6462a87584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:15Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5918e182-2860-4491-b7e7-a0a8a82cc574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5918e182-2860-4491-b7e7-a0a8a82cc574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37414057-0c29-4b5d-89fb-63e7ace5f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37414057-0c29-4b5d-89fb-63e7ace5f155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f872097-8778-4c97-94c0-bb6462a87584', 'volume_name': 'volume-1f872097-8778-4c97-94c0-bb6462a87584', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b843b05-42fb-40c3-b4a6-b1c9de68e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b843b05-42fb-40c3-b4a6-b1c9de68e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97bebe9-1ce4-42fd-8c71-dffde54beffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Volume 1f872097-8778-4c97-94c0-bb6462a87584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f872097-8778-4c97-94c0-bb6462a87584', 'volume_size': 1} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2005389510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f872097-8778-4c97-94c0-bb6462a87584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:15Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Creating volume 1f872097-8778-4c97-94c0-bb6462a87584 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2ff78553-7bb8-4a1e-b4ca-dfbfd76baf7d tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" by "detach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:14 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 1073741824 Apr 02 19:56:14 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2ff78553-7bb8-4a1e-b4ca-dfbfd76baf7d tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2ff78553-7bb8-4a1e-b4ca-dfbfd76baf7d tempest-VolumesActionsTest-1512179731 None] Volume detach called, but volume not attached. Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2ff78553-7bb8-4a1e-b4ca-dfbfd76baf7d tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (365a04cd-1971-4e15-ab48-311bccea02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d51a1b6-67c3-4575-b950-656cf323443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d51a1b6-67c3-4575-b950-656cf323443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1696380960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ff0407-962a-40d7-9031-c1f568d6cb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:15Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189f7965-a365-46bd-9a89-d4274ee799f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189f7965-a365-46bd-9a89-d4274ee799f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245c174f-8c89-46b8-b335-b2da156958d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245c174f-8c89-46b8-b335-b2da156958d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ff0407-962a-40d7-9031-c1f568d6cb09', 'volume_name': 'volume-93ff0407-962a-40d7-9031-c1f568d6cb09', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5064a51-90f0-411a-b590-24f559860ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5064a51-90f0-411a-b590-24f559860ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e751f0-271f-4311-bcea-2fe8a7bb60a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume 93ff0407-962a-40d7-9031-c1f568d6cb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ff0407-962a-40d7-9031-c1f568d6cb09', 'volume_size': 1} Apr 02 19:56:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:15 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 1073741824" returned: 0 in 0.678s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-quobyte-c54def31-acdc-440f-93c5-2129b1c7bf71" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "cinder-quobyte-c54def31-acdc-440f-93c5-2129b1c7bf71" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:15 devstack sudo[85091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 Apr 02 19:56:15 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c88c23-4736-48ff-a335-2aea59180d53]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:15 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 Apr 02 19:56:15 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:15 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1696380960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ff0407-962a-40d7-9031-c1f568d6cb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:15Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating volume 93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:15 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97bebe9-1ce4-42fd-8c71-dffde54beffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f872097-8778-4c97-94c0-bb6462a87584', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39228952-a556-4fef-85d3-515379fd505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:15 devstack sudo[85101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 1073741824 Apr 02 19:56:15 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:15 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Volume volume-1f872097-8778-4c97-94c0-bb6462a87584 (1f872097-8778-4c97-94c0-bb6462a87584): created successfully Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39228952-a556-4fef-85d3-515379fd505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (6cb9de78-53e2-45df-a04d-b95f1a3e88c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-dd10baa8-b91d-4784-8f1f-a453fe4f6381 tempest-VolumesTestJSON-1260983935 None] Created volume successfully. Apr 02 19:56:16 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71" returned: 0 in 0.630s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:16 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71 Apr 02 19:56:16 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:16 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 1073741824" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:16 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:16 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:16 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c54def31-acdc-440f-93c5-2129b1c7bf71" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "cinder-quobyte-c54def31-acdc-440f-93c5-2129b1c7bf71" released by "delete_volume" :: held 1.078s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Created reservations ['ce7233de-002f-41a8-a98f-d54f1b273d84', 'f78ff728-f375-40ff-b399-885c9864668a', '9f4ff337-f67c-4933-b6d1-253f3da67e02', 'd13191c4-059f-439c-8c4f-1e4ad7a241dc'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:16 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:16 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:16 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e751f0-271f-4311-bcea-2fe8a7bb60a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ff0407-962a-40d7-9031-c1f568d6cb09', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908575e-5d2b-4ce0-95bd-9bf5e79cb183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:16 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume volume-93ff0407-962a-40d7-9031-c1f568d6cb09 (93ff0407-962a-40d7-9031-c1f568d6cb09): created successfully Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e908575e-5d2b-4ce0-95bd-9bf5e79cb183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (365a04cd-1971-4e15-ab48-311bccea02ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1f499f86-b7c2-4ba1-a8e0-40cdbe331c65 tempest-VolumesSnapshotTestJSON-1706075825 None] Created volume successfully. Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:17 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (9040f5fe-1060-4467-aabc-33e1828de3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9556d9de-b2dc-4006-8582-2482325d0db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.612s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Deleted volume successfully. Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9556d9de-b2dc-4006-8582-2482325d0db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-896535908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9bec08-8680-4c69-adb5-4bc075fef96c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:17Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9014bf-b7cb-4f5d-a722-c62496c5090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9014bf-b7cb-4f5d-a722-c62496c5090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e105b6-9643-468a-a414-09a2e3004924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e105b6-9643-468a-a414-09a2e3004924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9bec08-8680-4c69-adb5-4bc075fef96c', 'volume_name': 'volume-ed9bec08-8680-4c69-adb5-4bc075fef96c', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83277f67-2f3b-4864-ac6c-bd57792d3149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83277f67-2f3b-4864-ac6c-bd57792d3149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b95436-1c98-4baa-a090-9bfb525b8f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:17 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Volume ed9bec08-8680-4c69-adb5-4bc075fef96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9bec08-8680-4c69-adb5-4bc075fef96c', 'volume_size': 1} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-896535908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9bec08-8680-4c69-adb5-4bc075fef96c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b655a6eb8846d59ea4e09f46363503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:17Z,use_quota=True,user_id='00d3f1bdcf1145aab92689f04a0495cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Creating volume ed9bec08-8680-4c69-adb5-4bc075fef96c {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:17 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0b53298a-34c3-4a5b-9c90-0858a3406fa4 tempest-VolumesActionsTest-1512179731 None] Lock "cinder-c54def31-acdc-440f-93c5-2129b1c7bf71-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:17 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c 1073741824 Apr 02 19:56:17 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:17 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c 1073741824" returned: 0 in 0.524s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:17 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c Apr 02 19:56:17 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:18 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b95436-1c98-4baa-a090-9bfb525b8f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9bec08-8680-4c69-adb5-4bc075fef96c', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe851cc-072f-43c1-9007-3b0e869784ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:18 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Volume volume-ed9bec08-8680-4c69-adb5-4bc075fef96c (ed9bec08-8680-4c69-adb5-4bc075fef96c): created successfully Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe851cc-072f-43c1-9007-3b0e869784ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Flow 'volume_create_manager' (9040f5fe-1060-4467-aabc-33e1828de3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating offline snapshot 47d50610-7c0f-4b85-b727-dd9cb9f57e19 of volume 93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:56:18 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-84eeb728-049b-4466-8d05-c1d2b2585e69 tempest-VolumesTestJSON-1260983935 None] Created volume successfully. Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c75a29-864c-4189-8946-329a6dea5b46]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:18 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:18 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:18 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.493s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:18 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 1G Apr 02 19:56:18 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:19 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 1G" returned: 0 in 0.519s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ff0407-962a-40d7-9031-c1f568d6cb09 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:19 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ff0407-962a-40d7-9031-c1f568d6cb09 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:19 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:19 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ff0407-962a-40d7-9031-c1f568d6cb09 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.467s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:19 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 is being set with open permissions: ugo+rw Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:19 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:19 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-ed9bec08-8680-4c69-adb5-4bc075fef96c-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "cinder-ed9bec08-8680-4c69-adb5-4bc075fef96c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-quobyte-ed9bec08-8680-4c69-adb5-4bc075fef96c" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-ed9bec08-8680-4c69-adb5-4bc075fef96c" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10a608-0931-452a-9e34-b2401eed4ffa]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:20 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c Apr 02 19:56:20 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:20 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:20 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info Apr 02 19:56:20 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:20 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c" returned: 0 in 0.638s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:20 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c Apr 02 19:56:20 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:20 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info" returned: 0 in 0.556s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:20 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info is being set with open permissions: ugo+rw Apr 02 19:56:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:20 devstack sudo[85182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info Apr 02 19:56:20 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:21 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed9bec08-8680-4c69-adb5-4bc075fef96c" returned: 0 in 0.479s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-ed9bec08-8680-4c69-adb5-4bc075fef96c" released by "delete_volume" :: held 1.145s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Created reservations ['9b5a44e0-257f-44c8-a51f-692059f71406', '100210fa-1266-449c-9f93-bb6c07e25e0a', '7483d002-82c3-4123-ad5c-6ea7cc1f9bd2', 'b311b3b2-4ae9-498a-81d4-da48dc273a8f'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:21 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.info" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.999s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:21 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cc6698f2-45f0-4ccb-a676-7efd252b0063 tempest-VolumesSnapshotTestJSON-1706075825 None] Create snapshot completed successfully Apr 02 19:56:21 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:21 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (ec6f1c88-bf99-45be-9e0c-593f2eab2c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a5bd2b-b0e8-447f-acd6-9a1ed8a951e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a5bd2b-b0e8-447f-acd6-9a1ed8a951e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-38131541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348bd1cd-5234-4ecb-8542-876db1db542b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=47d50610-7c0f-4b85-b727-dd9cb9f57e19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:22Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fcd93-e49c-4fc2-94e6-4756fc5ba79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721fcd93-e49c-4fc2-94e6-4756fc5ba79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d6010-c666-414d-bda3-b669fbd8d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d6010-c666-414d-bda3-b669fbd8d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '348bd1cd-5234-4ecb-8542-876db1db542b', 'volume_name': 'volume-348bd1cd-5234-4ecb-8542-876db1db542b', 'volume_size': 2, 'snapshot_id': '47d50610-7c0f-4b85-b727-dd9cb9f57e19'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0b2e63-498b-4b78-a1d1-9224eb9fb394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0b2e63-498b-4b78-a1d1-9224eb9fb394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b05236-4405-4c07-aea5-bc5daef9d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:21 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume 348bd1cd-5234-4ecb-8542-876db1db542b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-348bd1cd-5234-4ecb-8542-876db1db542b', 'volume_size': 2, 'snapshot_id': '47d50610-7c0f-4b85-b727-dd9cb9f57e19'} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19-348bd1cd-5234-4ecb-8542-876db1db542b" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19-348bd1cd-5234-4ecb-8542-876db1db542b" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating volume 348bd1cd-5234-4ecb-8542-876db1db542b from snapshot 47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] snapshot: 47d50610-7c0f-4b85-b727-dd9cb9f57e19, volume: 348bd1cd-5234-4ecb-8542-876db1db542b, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 19:56:21 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.536s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd96793-0378-41cc-a399-61a56bc839c3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:21 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Deleted volume successfully. Apr 02 19:56:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3b671d53-18b2-4708-a9a9-9f96a68e069b tempest-VolumesTestJSON-1260983935 None] Lock "cinder-ed9bec08-8680-4c69-adb5-4bc075fef96c-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:21 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:21 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-1f872097-8778-4c97-94c0-bb6462a87584-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-1f872097-8778-4c97-94c0-bb6462a87584-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-quobyte-1f872097-8778-4c97-94c0-bb6462a87584" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-1f872097-8778-4c97-94c0-bb6462a87584" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bcf764-7d02-42d7-bc2d-91275624e7fb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:22 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 Apr 02 19:56:22 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:22 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.627s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ff0407-962a-40d7-9031-c1f568d6cb09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6fc271-159e-4249-8eb6-e20f53d74887]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:22 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:22 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:22 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584" returned: 0 in 0.536s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:22 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584 Apr 02 19:56:22 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:22 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 19:56:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:22 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b Apr 02 19:56:22 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:23 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1f872097-8778-4c97-94c0-bb6462a87584" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-1f872097-8778-4c97-94c0-bb6462a87584" released by "delete_volume" :: held 1.006s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Created reservations ['485e6331-fe6a-4b21-ae6b-d4bc076b80b7', '5ed329ae-af21-4d83-8524-174c09160062', '9044fd80-ce7b-4162-afbf-175926240005', '93a31085-08f4-4752-aa37-3d29d9c59a1d'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:23 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:23 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:24 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 1.032s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Deleted volume successfully. Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-e9fcb8d4-c194-4737-887b-df03a2bb9fa2-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6a8f1afc-2a3a-4d0f-b3a2-906c516584e8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-1f872097-8778-4c97-94c0-bb6462a87584-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-e9fcb8d4-c194-4737-887b-df03a2bb9fa2-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (b10e1dde-4ad0-48c7-8c8f-5d1345725215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55bd6df-9753-4c47-85f5-d089f73df7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55bd6df-9753-4c47-85f5-d089f73df7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729342883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62e36e8-57c1-4d62-acfd-80259c21e7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:25Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972b4a9f-394b-465b-a76a-a3e2106ea0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972b4a9f-394b-465b-a76a-a3e2106ea0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539817f3-223b-4f55-8636-2925d07e8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539817f3-223b-4f55-8636-2925d07e8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62e36e8-57c1-4d62-acfd-80259c21e7f2', 'volume_name': 'volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850b845e-1109-4491-90f8-e09fa9f798ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850b845e-1109-4491-90f8-e09fa9f798ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41975d-4201-48f7-af5c-618ebdad27d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:24 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Volume f62e36e8-57c1-4d62-acfd-80259c21e7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2', 'volume_size': 1} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "cinder-quobyte-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1385737-8088-4686-a419-ecb76a237b38]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:25 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 Apr 02 19:56:25 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:25 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b" returned: 0 in 2.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b81172-679b-4233-94e1-0a870cb19461]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:25 devstack sudo[85294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:25 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:25 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" returned: 0 in 0.872s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:25 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2 Apr 02 19:56:25 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:26 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:26 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.641s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:56:26 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Converted 1024.00 MB image at 397.21 MB/s Apr 02 19:56:26 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b is being set with open permissions: ugo+rw Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-quobyte-e9fcb8d4-c194-4737-887b-df03a2bb9fa2" released by "delete_volume" :: held 1.386s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:26 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b Apr 02 19:56:26 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Created reservations ['45aebd75-aa63-49d2-a2be-1e8080e90130', '40da30fb-3c7e-48e1-b593-d947de7d4fed', '93481e54-a18e-444c-ab78-dbce4ebd850b', '10bd639f-fcae-4651-ad3c-cfe1519bfb6a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:26 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:26 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:26 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b" returned: 0 in 0.388s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" released by "_copy_volume_from_snapshot" :: held 4.787s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19-348bd1cd-5234-4ecb-8542-876db1db542b" released by "_create_volume_from_snapshot" :: held 4.810s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.822s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-729342883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62e36e8-57c1-4d62-acfd-80259c21e7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:25Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Creating volume f62e36e8-57c1-4d62-acfd-80259c21e7f2 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:26 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:26 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 1073741824 Apr 02 19:56:26 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b05236-4405-4c07-aea5-bc5daef9d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348bd1cd-5234-4ecb-8542-876db1db542b', 'volume_size': 2, 'snapshot_id': '47d50610-7c0f-4b85-b727-dd9cb9f57e19'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623c1a7-5424-4da4-ac9d-1fa46e448ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:26 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume volume-348bd1cd-5234-4ecb-8542-876db1db542b (348bd1cd-5234-4ecb-8542-876db1db542b): created successfully Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623c1a7-5424-4da4-ac9d-1fa46e448ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (ec6f1c88-bf99-45be-9e0c-593f2eab2c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:26 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:26 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Deleted volume successfully. Apr 02 19:56:26 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4b037c27-5666-4456-9be4-caff94ceeab2 tempest-VolumesSnapshotTestJSON-1706075825 None] Created volume successfully. Apr 02 19:56:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-42c2a99b-43a9-43f5-a8f4-c5293e523ff8 tempest-VolumesTestJSON-1260983935 None] Lock "cinder-e9fcb8d4-c194-4737-887b-df03a2bb9fa2-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-348bd1cd-5234-4ecb-8542-876db1db542b-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-348bd1cd-5234-4ecb-8542-876db1db542b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:27 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 1073741824" returned: 0 in 0.586s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d99715-5e2c-42dc-8342-7fef5f32e4c6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:27 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 Apr 02 19:56:27 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:27 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b Apr 02 19:56:27 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:27 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2" returned: 0 in 0.610s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41975d-4201-48f7-af5c-618ebdad27d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66946e15-406b-4814-9bfd-c71674f92c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:27 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Volume volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 (f62e36e8-57c1-4d62-acfd-80259c21e7f2): created successfully Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66946e15-406b-4814-9bfd-c71674f92c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (b10e1dde-4ad0-48c7-8c8f-5d1345725215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a8e9baf3-376a-4833-927f-a6bd9c0159b7 tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:28 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b" returned: 0 in 0.904s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:28 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b Apr 02 19:56:28 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:28 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-348bd1cd-5234-4ecb-8542-876db1db542b" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-348bd1cd-5234-4ecb-8542-876db1db542b" released by "delete_volume" :: held 1.411s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['80282ad3-60f1-48dc-8303-9b7437c670d2', 'fb56d520-4294-4cf4-ac82-44de8b1815f9', 'c13b524b-49f2-4f79-9c7e-6156b9ed3a44', '0f39a1b5-472b-4931-b419-9f274f1c5d91'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:28 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:28 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-f62e36e8-57c1-4d62-acfd-80259c21e7f2-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "cinder-f62e36e8-57c1-4d62-acfd-80259c21e7f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-quobyte-f62e36e8-57c1-4d62-acfd-80259c21e7f2" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-f62e36e8-57c1-4d62-acfd-80259c21e7f2" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a383dc8-d193-49a7-9f3a-eeaf1c1bd8fe]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:29 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 Apr 02 19:56:29 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:29 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleted volume successfully. Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6cf10c7d-7b97-44f7-9727-65722cfd75b8 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-348bd1cd-5234-4ecb-8542-876db1db542b-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-47d50610-7c0f-4b85-b727-dd9cb9f57e19-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-47d50610-7c0f-4b85-b727-dd9cb9f57e19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleting offline snapshot 47d50610-7c0f-4b85-b727-dd9cb9f57e19 of volume 93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] snapshot_file for this snap is: volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf988d-308a-475b-a84d-474eeebb522e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cbabdfe1-964d-4ada-a8cf-ac7c6ad29ad5 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-1702750581: creating Apr 02 19:56:29 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:29 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cbabdfe1-964d-4ada-a8cf-ac7c6ad29ad5 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-1702750581: created successfully Apr 02 19:56:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cbabdfe1-964d-4ada-a8cf-ac7c6ad29ad5 tempest-GroupSnapshotsTest-1191287497 None] Create group completed successfully. Apr 02 19:56:29 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2" returned: 0 in 0.600s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:29 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2 Apr 02 19:56:29 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:30 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.649s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ff0407-962a-40d7-9031-c1f568d6cb09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[16093f4d-19ae-4812-8528-ee8ac30fae3c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:30 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f62e36e8-57c1-4d62-acfd-80259c21e7f2" returned: 0 in 0.556s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-f62e36e8-57c1-4d62-acfd-80259c21e7f2" released by "delete_volume" :: held 1.189s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:30 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:30 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Created reservations ['d19b5ef0-98cc-4ce8-8279-b0c13636129c', '0f637787-d45e-4efc-8757-9bbd8bfc1f4e', '59277b82-43d0-43e5-962f-2a7a62472b0b', '2ee8be32-5e60-4f6a-b9c7-309363fd49d2'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:30 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:30 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:30 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.569s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:30 devstack sudo[85386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:30 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:30 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Deleted volume successfully. Apr 02 19:56:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c8004072-fb99-4ab8-8441-3f1f73b9acca tempest-VolumesActionsTest-274129931 None] Lock "cinder-f62e36e8-57c1-4d62-acfd-80259c21e7f2-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (7a5522b2-2a59-4fb3-be90-8bfe93251276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714f0e6e-6c9d-4773-ab53-75700b2f5108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714f0e6e-6c9d-4773-ab53-75700b2f5108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937193284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=191dba03-e570-4c0f-8b37-f3bc541ed52d,host='devstack@QuobyteHD#QuobyteHD',id=a480219d-a4e6-4623-8149-a44aca4bc618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:31Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b37af77b-8770-4e5b-ad54-c68cfb582bac),volume_type_id=b37af77b-8770-4e5b-ad54-c68cfb582bac)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4b7d3-bf0e-44be-b261-85f6c0a1ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4b7d3-bf0e-44be-b261-85f6c0a1ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1985a2-a19c-42ca-b816-8167af8fec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1985a2-a19c-42ca-b816-8167af8fec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a480219d-a4e6-4623-8149-a44aca4bc618', 'volume_name': 'volume-a480219d-a4e6-4623-8149-a44aca4bc618', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3dc21-5bf9-42d3-8239-00f6b1407c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba3dc21-5bf9-42d3-8239-00f6b1407c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6012d77-4348-4b39-ac1a-c7c8c0e81b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Volume a480219d-a4e6-4623-8149-a44aca4bc618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a480219d-a4e6-4623-8149-a44aca4bc618', 'volume_size': 1} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=191dba03-e570-4c0f-8b37-f3bc541ed52d,created_at=2026-04-02T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937193284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=191dba03-e570-4c0f-8b37-f3bc541ed52d,host='devstack@QuobyteHD#QuobyteHD',id=a480219d-a4e6-4623-8149-a44aca4bc618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:31Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b37af77b-8770-4e5b-ad54-c68cfb582bac),volume_type_id=b37af77b-8770-4e5b-ad54-c68cfb582bac)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Creating volume a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:31 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:31 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 1073741824 Apr 02 19:56:31 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:31 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.546s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:31 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19 Apr 02 19:56:31 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (937b1264-4fdf-4438-94dc-9d29a42c3afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764a2032-169f-4ab0-977a-48e94eef737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764a2032-169f-4ab0-977a-48e94eef737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481552317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9942f678-27db-448a-b197-28aac094eb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:32Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c06bf72-cd0a-4c88-917f-cfb2838dbc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c06bf72-cd0a-4c88-917f-cfb2838dbc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ff573-62f9-4875-96a7-d9d090e727bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ff573-62f9-4875-96a7-d9d090e727bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9942f678-27db-448a-b197-28aac094eb30', 'volume_name': 'volume-9942f678-27db-448a-b197-28aac094eb30', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf9add1-5a9a-4072-be0f-184236211e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf9add1-5a9a-4072-be0f-184236211e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e06f0-d18e-47fd-8dce-9eabf5df1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:31 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Volume 9942f678-27db-448a-b197-28aac094eb30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9942f678-27db-448a-b197-28aac094eb30', 'volume_size': 1} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:31 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 1073741824" returned: 0 in 0.705s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:31 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:31 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:31 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09.47d50610-7c0f-4b85-b727-dd9cb9f57e19" returned: 0 in 0.599s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-47d50610-7c0f-4b85-b727-dd9cb9f57e19" released by "_delete_snapshot" :: held 2.451s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" released by "delete_snapshot" :: held 2.474s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['aa808dab-bd1d-46cb-914c-45f6da8690b2', '10378615-bf21-4ac2-8198-83d2ef79655a', '5f9c4b7f-805e-4eb8-afc6-72a2c74e5684', '8b5327f7-1e41-40b4-b8a6-b11ec01186ca'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Delete snapshot completed successfully. Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-11a921c2-f0df-42ed-bcb4-998367158819 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-47d50610-7c0f-4b85-b727-dd9cb9f57e19-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:32 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481552317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9942f678-27db-448a-b197-28aac094eb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:32Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Creating volume 9942f678-27db-448a-b197-28aac094eb30 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:32 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6012d77-4348-4b39-ac1a-c7c8c0e81b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a480219d-a4e6-4623-8149-a44aca4bc618', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df94c99c-f2dd-424b-85a7-c0c36497718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:32 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 1073741824 Apr 02 19:56:32 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:32 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Volume volume-a480219d-a4e6-4623-8149-a44aca4bc618 (a480219d-a4e6-4623-8149-a44aca4bc618): created successfully Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df94c99c-f2dd-424b-85a7-c0c36497718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (7a5522b2-2a59-4fb3-be90-8bfe93251276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-36cdba7d-0f92-454a-bb97-abdd8d38b98a tempest-GroupSnapshotsTest-1191287497 None] Created volume successfully. Apr 02 19:56:32 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 1073741824" returned: 0 in 0.483s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:32 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 Apr 02 19:56:32 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-93ff0407-962a-40d7-9031-c1f568d6cb09-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-93ff0407-962a-40d7-9031-c1f568d6cb09-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[025022c2-7e09-44f9-bfb6-cb7d1ae5425b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:32 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:32 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:33 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e06f0-d18e-47fd-8dce-9eabf5df1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9942f678-27db-448a-b197-28aac094eb30', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4b53f-7981-4011-b9cf-f6bc35619c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:33 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Volume volume-9942f678-27db-448a-b197-28aac094eb30 (9942f678-27db-448a-b197-28aac094eb30): created successfully Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4b53f-7981-4011-b9cf-f6bc35619c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (937b1264-4fdf-4438-94dc-9d29a42c3afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f9ce12ed-2335-41ea-ba10-3f2eb32b5d8e tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] GroupSnapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: creating. Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Group snapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: creating. {{(pid=82597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:33 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Creating offline snapshot 55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d of volume a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c8b86-af28-49fc-8567-bc29d9bf1635]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:33 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09 Apr 02 19:56:33 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:33 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:33 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-9942f678-27db-448a-b197-28aac094eb30-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "cinder-9942f678-27db-448a-b197-28aac094eb30-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:33 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-quobyte-9942f678-27db-448a-b197-28aac094eb30" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-93ff0407-962a-40d7-9031-c1f568d6cb09" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-9942f678-27db-448a-b197-28aac094eb30" acquired by "delete_volume" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-93ff0407-962a-40d7-9031-c1f568d6cb09" released by "delete_volume" :: held 1.057s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da404b3-8df4-4826-bb71-f2d47d72e628]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:33 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:33 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['8dfebbc4-1b4f-4ea4-86c5-6e34639d1413', 'a66b8c28-159e-4cd3-a87a-865d5fc5dad4', 'd4a0bcbe-b092-4a4d-a8fa-4cb35ab553a7', '2ad321f1-c1d8-464b-8506-3fa51658d4ef'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.598s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:34 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d 1G Apr 02 19:56:34 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:34 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 Apr 02 19:56:34 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:34 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:34 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:34 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30" returned: 0 in 0.609s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:34 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.542s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:34 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30 Apr 02 19:56:34 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleted volume successfully. Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f443e472-71f1-44fe-85c3-e49a71249055 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-93ff0407-962a-40d7-9031-c1f568d6cb09-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:34 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d 1G" returned: 0 in 0.621s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a480219d-a4e6-4623-8149-a44aca4bc618 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:34 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a480219d-a4e6-4623-8149-a44aca4bc618 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:34 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:35 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9942f678-27db-448a-b197-28aac094eb30" returned: 0 in 0.463s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-9942f678-27db-448a-b197-28aac094eb30" released by "delete_volume" :: held 1.117s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Created reservations ['d00144af-915d-4a16-9682-64c4f4b61575', '249b2354-270f-4a27-987a-60df1c737f4d', '4c47752a-1b91-4bed-bfdf-c1240522ea48', '190a3375-617c-4c72-81eb-de591a39b4f0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:35 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:35 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:35 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a480219d-a4e6-4623-8149-a44aca4bc618 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.627s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:35 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:35 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:35 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (5b5f0f88-67f9-44ff-b9f4-8ec01bac4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a377fd9-4c7c-40b7-995b-772253d142f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a377fd9-4c7c-40b7-995b-772253d142f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1967205339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b035214c-4177-4cc7-bb78-bdc9d26f7cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:35Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ead69ab-5c1f-4615-933e-79a0289a5ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ead69ab-5c1f-4615-933e-79a0289a5ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60664506-bdc5-4a56-bb47-6bda69c046c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60664506-bdc5-4a56-bb47-6bda69c046c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b035214c-4177-4cc7-bb78-bdc9d26f7cf6', 'volume_name': 'volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befaa763-13dd-4330-b976-a294c6150cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befaa763-13dd-4330-b976-a294c6150cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f4ece6-72a7-4d11-a642-40bf8d448b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:35 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Volume b035214c-4177-4cc7-bb78-bdc9d26f7cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6', 'volume_size': 1} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:35 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.543s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:35 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Deleted volume successfully. Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c7ab8fbc-ca8f-47ca-affa-fa2a2f16df25 tempest-VolumesActionsTest-274129931 None] Lock "cinder-9942f678-27db-448a-b197-28aac094eb30-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:35 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.699s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:36 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info Apr 02 19:56:36 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (cbc7d219-14ca-4e22-b469-d788559d7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe3a0d-a72f-43ba-9044-285b72a1f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbe3a0d-a72f-43ba-9044-285b72a1f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420794082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7cfa35-5c06-4724-ba10-331dcc94077a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:36Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c69bc5-c6b0-4f67-90e5-57d4299ecd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c69bc5-c6b0-4f67-90e5-57d4299ecd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7309032-3d2b-4ccd-8b5a-1e803fcf1b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7309032-3d2b-4ccd-8b5a-1e803fcf1b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7cfa35-5c06-4724-ba10-331dcc94077a', 'volume_name': 'volume-8f7cfa35-5c06-4724-ba10-331dcc94077a', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4559d0e8-8e22-4270-85a9-48c1b77b8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4559d0e8-8e22-4270-85a9-48c1b77b8949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e11b9-bb97-42dc-b2da-40eb6c9bb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:36 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Volume 8f7cfa35-5c06-4724-ba10-331dcc94077a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7cfa35-5c06-4724-ba10-331dcc94077a', 'volume_size': 1} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:36 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info" returned: 0 in 0.540s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:36 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:36 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info Apr 02 19:56:36 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:36 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.info" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.595s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1967205339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b035214c-4177-4cc7-bb78-bdc9d26f7cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:35Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Creating volume b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:36 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:37 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 1073741824 Apr 02 19:56:37 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-168f2116-58c8-49c0-98e7-c6dc8e1205b8 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: created successfully Apr 02 19:56:37 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 1073741824" returned: 0 in 0.695s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:37 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:56:37 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:38 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.423s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-420794082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7cfa35-5c06-4724-ba10-331dcc94077a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:36Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Creating volume 8f7cfa35-5c06-4724-ba10-331dcc94077a {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:38 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f4ece6-72a7-4d11-a642-40bf8d448b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b8707c-13d4-4ef0-a3e7-a08e2c730913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:38 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a 1073741824 Apr 02 19:56:38 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:38 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Volume volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 (b035214c-4177-4cc7-bb78-bdc9d26f7cf6): created successfully Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b8707c-13d4-4ef0-a3e7-a08e2c730913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (5b5f0f88-67f9-44ff-b9f4-8ec01bac4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6791f4d3-b6b1-4aec-988b-7655f96310bd tempest-VolumesSnapshotTestJSON-1706075825 None] Created volume successfully. Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:38 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a 1073741824" returned: 0 in 0.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:38 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a Apr 02 19:56:38 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:39 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.671s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d-64371a53-4788-46c2-a9b9-2551f63f5462" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d-64371a53-4788-46c2-a9b9-2551f63f5462" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Creating volume 64371a53-4788-46c2-a9b9-2551f63f5462 from snapshot 55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e11b9-bb97-42dc-b2da-40eb6c9bb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7cfa35-5c06-4724-ba10-331dcc94077a', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa88ced-dd25-4bf5-9190-3c68859a1d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] snapshot: 55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d, volume: 64371a53-4788-46c2-a9b9-2551f63f5462, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 19:56:39 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Volume volume-8f7cfa35-5c06-4724-ba10-331dcc94077a (8f7cfa35-5c06-4724-ba10-331dcc94077a): created successfully Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa88ced-dd25-4bf5-9190-3c68859a1d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (cbc7d219-14ca-4e22-b469-d788559d7129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:39 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-eecb070f-a755-4049-9657-c5226e5a4534 tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56afedb-52ec-4938-8abb-eab2b1e8cdb0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:39 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:39 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-8f7cfa35-5c06-4724-ba10-331dcc94077a-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "cinder-8f7cfa35-5c06-4724-ba10-331dcc94077a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-quobyte-8f7cfa35-5c06-4724-ba10-331dcc94077a" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-8f7cfa35-5c06-4724-ba10-331dcc94077a" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2da873-c24f-40f1-a7aa-5079c2b239ed]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:39 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a Apr 02 19:56:39 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:39 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.562s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a480219d-a4e6-4623-8149-a44aca4bc618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddefd2b-a65a-415c-9733-3789eaa4e945]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:39 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:39 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:40 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:40 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a Apr 02 19:56:40 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:40 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:40 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 Apr 02 19:56:40 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:40 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f7cfa35-5c06-4724-ba10-331dcc94077a" returned: 0 in 0.420s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-8f7cfa35-5c06-4724-ba10-331dcc94077a" released by "delete_volume" :: held 0.959s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Created reservations ['8cef2ac8-ec43-4d43-be58-afc3f9b1975f', '61566db5-1696-452d-8e5a-3e76b78cdf94', '1f071aab-ec8c-4a09-b6de-eb365b84703b', 'a06ad231-21b6-478d-85d8-57e4af7806b5'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:40 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:40 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:42 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 1.352s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Deleted volume successfully. Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (a90f9844-c905-4c8a-ab3f-4285028bd148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d299db-cb67-4474-8113-b844019b8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8109dc69-d401-4d4b-9bf1-f3046e557f14 tempest-VolumesActionsTest-274129931 None] Lock "cinder-8f7cfa35-5c06-4724-ba10-331dcc94077a-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d299db-cb67-4474-8113-b844019b8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897295545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f676b-f2ce-49f9-bd6c-4a96979a94b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:42Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6b7bc7-17cd-41d6-9cf5-58028567401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6b7bc7-17cd-41d6-9cf5-58028567401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7921ac-f139-46a1-97a6-48cf13f05c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7921ac-f139-46a1-97a6-48cf13f05c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096f676b-f2ce-49f9-bd6c-4a96979a94b1', 'volume_name': 'volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2454f8-8c8b-4ce5-ab56-1e06456d3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2454f8-8c8b-4ce5-ab56-1e06456d3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ad3d96-f7a6-4ad4-934a-d09a025f9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Volume 096f676b-f2ce-49f9-bd6c-4a96979a94b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1', 'volume_size': 1} Apr 02 19:56:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:43 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462" returned: 0 in 2.956s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e086e7e-cbe2-439b-97bb-3361fbc2377c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:43 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:43 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:43 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.652s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618, size 1024.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:56:43 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Converted 1024.00 MB image at 346.00 MB/s Apr 02 19:56:43 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:56:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:43 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 Apr 02 19:56:43 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Flow 'volume_create_manager' (f26bf3e7-97b3-4171-9b12-20b06fea24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbfeb13-45e3-475a-97e8-13a0dbb0185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbfeb13-45e3-475a-97e8-13a0dbb0185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:44Z,deleted=False,deleted_at=None,display_description='',display_name='fb48c43d-0bcc-440a-af94-3d447c06c8df-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a3c178-4236-4706-92e7-e98f5a72d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3193fd499f143ed99e5dc5d29e9fdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:44Z,use_quota=True,user_id='f4281fd58ab34a9b98c45703614e403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e226e61-72d1-4480-8581-5b7deccf619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e226e61-72d1-4480-8581-5b7deccf619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9448fd05-1147-4797-b46d-addca45db0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9448fd05-1147-4797-b46d-addca45db0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a3c178-4236-4706-92e7-e98f5a72d516', 'volume_name': 'volume-35a3c178-4236-4706-92e7-e98f5a72d516', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255140e-2a06-40cb-b83b-277693fd2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255140e-2a06-40cb-b83b-277693fd2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487be1b6-23ec-4985-a947-2c5bafde16ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:44 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume 35a3c178-4236-4706-92e7-e98f5a72d516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a3c178-4236-4706-92e7-e98f5a72d516', 'volume_size': 1} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:44 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462" returned: 0 in 0.531s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" released by "_copy_volume_from_snapshot" :: held 5.300s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d-64371a53-4788-46c2-a9b9-2551f63f5462" released by "_create_volume_from_snapshot" :: held 5.340s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.355s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.618s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating offline snapshot 66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 of volume b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab117e-0092-46a2-8d26-5e0d945ea71d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1813ea12-6f4f-447a-a6de-229e6c15e6ed tempest-GroupSnapshotsTest-1191287497 None] Create group from source-snapshot-91b8f6e7-240e-42fc-9739-e1d28db3ae29 completed successfully. Apr 02 19:56:44 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:56:44 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:45 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:45 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 1G Apr 02 19:56:45 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:45 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 1G" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:45 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:45 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59be964-56f5-405c-9e76-699b11b62397]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:45 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 Apr 02 19:56:45 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:46 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:46 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 is being set with open permissions: ugo+rw Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:46 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:46 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:46 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:46 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462 Apr 02 19:56:46 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:46 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:46 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info Apr 02 19:56:46 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:46 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-64371a53-4788-46c2-a9b9-2551f63f5462" returned: 0 in 0.471s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-64371a53-4788-46c2-a9b9-2551f63f5462" released by "delete_volume" :: held 0.996s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['8e7d018b-7bbe-453a-a916-0a5ba2d20aed'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:46 devstack cinder-volume[82597]: WARNING cinder.quota [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1541320880 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1541320880, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:56:46 devstack cinder-volume[82597]: WARNING cinder.quota [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1541320880 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1541320880, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:56:46 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['14f67282-6374-4cab-a2a0-adfdf8df29a6', '59797e6c-8f76-4645-913a-8a2773bbe202', 'c5d56a21-d54b-4f2e-9dc9-1bf8a0037194', '0131478d-118b-4bb3-ad5d-c37fbed3726d'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:47 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:47 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:47 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info" returned: 0 in 0.574s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:47 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info is being set with open permissions: ugo+rw Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:47 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info Apr 02 19:56:47 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:47 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.429s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-41c89ca2-9f02-4ee9-94c9-e9a1cc579b56 tempest-GroupSnapshotsTest-1191287497 None] Delete group completed successfully. Apr 02 19:56:47 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.info" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.688s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897295545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f676b-f2ce-49f9-bd6c-4a96979a94b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:42Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Creating volume 096f676b-f2ce-49f9-bd6c-4a96979a94b1 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:47 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:47 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 1073741824 Apr 02 19:56:47 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-23c7c430-8e63-4f6e-987b-89cab14f34f9 tempest-VolumesSnapshotTestJSON-1706075825 None] Create snapshot completed successfully Apr 02 19:56:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: deleting Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: deleting {{(pid=82597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 19:56:48 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 1073741824" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Deleting offline snapshot 55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d of volume a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:56:48 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] snapshot_file for this snap is: volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:56:48 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b41dc-0ddc-471b-a6d2-a14598deb461]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:48 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:48 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (840eb708-892c-49a2-9487-3b307ae31cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37fb01a-952f-4d15-a15c-ff1efee98ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37fb01a-952f-4d15-a15c-ff1efee98ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1767754103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adecbf18-102e-4885-b297-2a6057524bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0840c4ddf564d6586f5b3a447177e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=66bfbcc7-9f6c-4d58-9a8c-6756a850abc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:49Z,use_quota=True,user_id='03539cdfa9304c13ae66b3de1013c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78fafa2-e23b-4e18-9a58-09d859123942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78fafa2-e23b-4e18-9a58-09d859123942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88862cdc-6ba7-49d4-aca1-b2c0144596fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88862cdc-6ba7-49d4-aca1-b2c0144596fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adecbf18-102e-4885-b297-2a6057524bda', 'volume_name': 'volume-adecbf18-102e-4885-b297-2a6057524bda', 'volume_size': 1, 'snapshot_id': '66bfbcc7-9f6c-4d58-9a8c-6756a850abc5'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f4f807-4e5e-4f37-affe-b14cea0ef3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f4f807-4e5e-4f37-affe-b14cea0ef3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de6b802-2dc1-4681-8096-e7baaa365ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume adecbf18-102e-4885-b297-2a6057524bda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adecbf18-102e-4885-b297-2a6057524bda', 'volume_size': 1, 'snapshot_id': '66bfbcc7-9f6c-4d58-9a8c-6756a850abc5'} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:48 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.548s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:44Z,deleted=False,deleted_at=None,display_description='',display_name='fb48c43d-0bcc-440a-af94-3d447c06c8df-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a3c178-4236-4706-92e7-e98f5a72d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3193fd499f143ed99e5dc5d29e9fdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:44Z,use_quota=True,user_id='f4281fd58ab34a9b98c45703614e403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Creating volume 35a3c178-4236-4706-92e7-e98f5a72d516 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:48 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ad3d96-f7a6-4ad4-934a-d09a025f9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 1073741824 Apr 02 19:56:48 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206778f6-a59f-4cd8-9f7a-4b9936125bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:48 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Volume volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 (096f676b-f2ce-49f9-bd6c-4a96979a94b1): created successfully Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206778f6-a59f-4cd8-9f7a-4b9936125bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (a90f9844-c905-4c8a-ab3f-4285028bd148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-162b459c-f823-4e5c-8b43-b223e0dce6e6 tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:48 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.566s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a480219d-a4e6-4623-8149-a44aca4bc618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2339c-5575-41eb-872b-0b449adb35b2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:48 devstack sudo[85615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:48 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:49 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 1073741824" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:49 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 Apr 02 19:56:49 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:49 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.567s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:49 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:49 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-096f676b-f2ce-49f9-bd6c-4a96979a94b1-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:49 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "cinder-096f676b-f2ce-49f9-bd6c-4a96979a94b1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516" returned: 0 in 0.473s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.032s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-adecbf18-102e-4885-b297-2a6057524bda" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487be1b6-23ec-4985-a947-2c5bafde16ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a3c178-4236-4706-92e7-e98f5a72d516', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bfed7e-95b2-4ca5-8acc-09c781e83291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-adecbf18-102e-4885-b297-2a6057524bda" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating volume adecbf18-102e-4885-b297-2a6057524bda from snapshot 66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume volume-35a3c178-4236-4706-92e7-e98f5a72d516 (35a3c178-4236-4706-92e7-e98f5a72d516): created successfully Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bfed7e-95b2-4ca5-8acc-09c781e83291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Flow 'volume_create_manager' (f26bf3e7-97b3-4171-9b12-20b06fea24e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] snapshot: 66bfbcc7-9f6c-4d58-9a8c-6756a850abc5, volume: adecbf18-102e-4885-b297-2a6057524bda, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 19:56:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-93aa5d6d-92af-4591-b483-59a983126f17 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Created volume successfully. Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Acquiring lock "cinder-quobyte-096f676b-f2ce-49f9-bd6c-4a96979a94b1" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-096f676b-f2ce-49f9-bd6c-4a96979a94b1" acquired by "delete_volume" :: waited 0.024s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4827cc4-f9de-4070-92c4-950877d812bc]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726ac6a-3bc1-4b17-aba7-2aea3d629a56]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:49 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.511s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:49 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d Apr 02 19:56:49 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:49 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:49 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:49 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 Apr 02 19:56:49 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:50 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618.55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" returned: 0 in 0.483s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-55ee4ddd-5591-4d4b-8354-c3a5d0b7f46d" released by "_delete_snapshot" :: held 2.190s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" released by "delete_snapshot" :: held 2.218s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:50 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1" returned: 0 in 0.589s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:50 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.657s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:50 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1 Apr 02 19:56:50 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade17082-5404-4e1f-9c39-5aeb24e0d0c1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:50 devstack cinder-volume[82597]: WARNING cinder.quota [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1541320880 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1541320880, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['070867f5-8599-44ea-9625-9f639f4e3655', '297c809e-ccef-46c7-885c-aaf046c13811', '1125cb99-29d8-4676-94d6-dc7eb06c54b2', '815b7857-66e2-477a-909a-f071c84ed292'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:50 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:56:50 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6f041dc6-e70c-464c-a2eb-98d222db83f3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 91b8f6e7-240e-42fc-9739-e1d28db3ae29: deleted successfully Apr 02 19:56:50 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-096f676b-f2ce-49f9-bd6c-4a96979a94b1" returned: 0 in 0.559s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "cinder-quobyte-096f676b-f2ce-49f9-bd6c-4a96979a94b1" released by "delete_volume" :: held 1.179s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Created reservations ['4ab36fc5-95f8-4841-93d9-a9670821b83f', '1e27865c-f907-4647-a151-a612f345bbbb', 'bf8cf9ed-a9d2-47fc-a2f0-96e1f014b1f5', 'de3fe8af-dd73-4db9-9932-d6ca36287fa0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:51 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.517s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:51 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda Apr 02 19:56:51 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:51 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:51 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:51 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.905s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:51 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:52 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Deleted volume successfully. Apr 02 19:56:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" acquired by "delete_volume" :: waited 0.141s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6165feb1-ce3c-4e4c-b732-cd1dda75d069 tempest-VolumesActionsTest-274129931 None] Lock "cinder-096f676b-f2ce-49f9-bd6c-4a96979a94b1-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b9b87-30d6-4edd-81a2-e5a6a7d18790]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:52 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:52 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (51f6c923-e438-4327-a5f0-8da998ca6aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adfdd81-f6a7-461e-b779-211f53cace69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adfdd81-f6a7-461e-b779-211f53cace69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026000176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69afed97-55ed-4290-a442-581e97e7c52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:53Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b225ea15-d78d-42e7-86d2-4fdf3cbfa41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b225ea15-d78d-42e7-86d2-4fdf3cbfa41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c988c756-f7fe-4ca4-a781-a4eb4e7cfd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c988c756-f7fe-4ca4-a781-a4eb4e7cfd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69afed97-55ed-4290-a442-581e97e7c52d', 'volume_name': 'volume-69afed97-55ed-4290-a442-581e97e7c52d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d9113f-474f-4d4e-a762-29d799b0a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d9113f-474f-4d4e-a762-29d799b0a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c08190-40cd-4bb6-aac0-deba5c7d41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:53 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Volume 69afed97-55ed-4290-a442-581e97e7c52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69afed97-55ed-4290-a442-581e97e7c52d', 'volume_size': 1} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:53 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda" returned: 0 in 2.709s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d2f99-44a0-421d-a862-5e32b907d940]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:53 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:56:53 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:53 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 1.673s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:53 devstack sudo[85691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618 Apr 02 19:56:53 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:54 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a480219d-a4e6-4623-8149-a44aca4bc618" returned: 0 in 0.384s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-a480219d-a4e6-4623-8149-a44aca4bc618" released by "delete_volume" :: held 2.144s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['22072367-e3a4-4b4c-ad5c-beb0099b21f8'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:54 devstack cinder-volume[82597]: WARNING cinder.db.sqlalchemy.api [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1541320880'] Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['4c96adf4-5801-4c51-9f4c-717afd3d99b6', 'da47c6b5-b92f-41fa-95e5-1ddd7afc7d48', '216df253-7be7-48c4-8d94-38313c83daea', 'e100c27f-d5ae-4767-a1ae-b626be6cf781'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:54 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.630s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6, size 1024.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:56:54 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Converted 1024.00 MB image at 377.84 MB/s Apr 02 19:56:54 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda is being set with open permissions: ugo+rw Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:54 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda Apr 02 19:56:54 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:54 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:54 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:54 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda" returned: 0 in 0.431s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" released by "_copy_volume_from_snapshot" :: held 5.042s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-adecbf18-102e-4885-b297-2a6057524bda" released by "_create_volume_from_snapshot" :: held 5.086s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.108s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.208s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[372c9e04-c7ef-4c8e-aab5-0345fcc69e84]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:54 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.457s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-32597c20-fdec-43e5-a813-13a2774e2898 tempest-GroupSnapshotsTest-1191287497 None] Delete group completed successfully. Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de6b802-2dc1-4681-8096-e7baaa365ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adecbf18-102e-4885-b297-2a6057524bda', 'volume_size': 1, 'snapshot_id': '66bfbcc7-9f6c-4d58-9a8c-6756a850abc5'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:54 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59851813-232a-47a1-919c-4adb915d4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:54 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:54 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Volume volume-adecbf18-102e-4885-b297-2a6057524bda (adecbf18-102e-4885-b297-2a6057524bda): created successfully Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59851813-232a-47a1-919c-4adb915d4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:54 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Flow 'volume_create_manager' (840eb708-892c-49a2-9487-3b307ae31cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-351635ec-f298-40a9-a25d-d46103c2c072 tempest-VolumesSnapshotTestJSON-1706075825 None] Created volume successfully. Apr 02 19:56:55 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.492s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026000176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69afed97-55ed-4290-a442-581e97e7c52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e5de5d29bd4c649956c24fac6846df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:53Z,use_quota=True,user_id='01f77630c63340f8967c06d3cdef73fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Creating volume 69afed97-55ed-4290-a442-581e97e7c52d {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:55 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:55 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d 1073741824 Apr 02 19:56:55 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b', 'name': 'volume-35a3c178-4236-4706-92e7-e98f5a72d516', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edef5385-adc9-4b2c-8498-76b590f9607b', 'enforce_multipath': True} {{(pid=82597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 19:56:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-a1b7d7dc-6c34-4846-8f65-a16ff962dda9 req-c7ff0c10-2268-457b-8d8f-db4863a77be5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] attachment_update completed successfully. Apr 02 19:56:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6975abaa-efcd-4975-998a-2e9167d50b66 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-1204366956: creating Apr 02 19:56:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6975abaa-efcd-4975-998a-2e9167d50b66 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-1204366956: created successfully Apr 02 19:56:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6975abaa-efcd-4975-998a-2e9167d50b66 tempest-GroupSnapshotsTest-1191287497 None] Create group completed successfully. Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-adecbf18-102e-4885-b297-2a6057524bda-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-adecbf18-102e-4885-b297-2a6057524bda-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:55 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d 1073741824" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500c92d-0be1-46a2-8bd6-43f1a754179e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:55 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d Apr 02 19:56:55 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:56 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda Apr 02 19:56:56 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:56 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d" returned: 0 in 0.429s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c08190-40cd-4bb6-aac0-deba5c7d41fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69afed97-55ed-4290-a442-581e97e7c52d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36de9d29-6a99-49d5-afb4-129c9b61e992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:56 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Volume volume-69afed97-55ed-4290-a442-581e97e7c52d (69afed97-55ed-4290-a442-581e97e7c52d): created successfully Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36de9d29-6a99-49d5-afb4-129c9b61e992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Flow 'volume_create_manager' (51f6c923-e438-4327-a5f0-8da998ca6aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-5496a7b3-32c6-4ffc-b73f-6b386b609818 tempest-VolumesActionsTest-1512179731 None] Created volume successfully. Apr 02 19:56:56 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda" returned: 0 in 0.537s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:56 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda Apr 02 19:56:56 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:57 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-adecbf18-102e-4885-b297-2a6057524bda" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-adecbf18-102e-4885-b297-2a6057524bda" released by "delete_volume" :: held 1.145s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (06b725b2-5b28-4d10-84a1-abd6a8195b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdd76a-4d3d-45ad-b7f0-b8e948c68742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['72a8445d-1a9a-40b1-ab4e-3d2e76556458', 'c6ec2151-53b9-49f3-9f11-026ea51a4f7a', 'cd1b89ac-a43d-45d7-ab9d-4e6e169927e9', '742c2b90-723b-4cbf-b6e2-ec91c82767d1'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdd76a-4d3d-45ad-b7f0-b8e948c68742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296804999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,host='devstack@QuobyteHD#QuobyteHD',id=59d39ef0-065b-43ca-b622-b5056fc6d173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:57Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89eed2ee-3eed-41ca-a652-93e58075ff85),volume_type_id=89eed2ee-3eed-41ca-a652-93e58075ff85)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231ff83e-9ac0-40d5-b350-0335fb165ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231ff83e-9ac0-40d5-b350-0335fb165ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8225d8b-6bbd-40df-88b8-1adeca81efa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8225d8b-6bbd-40df-88b8-1adeca81efa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d39ef0-065b-43ca-b622-b5056fc6d173', 'volume_name': 'volume-59d39ef0-065b-43ca-b622-b5056fc6d173', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f2943-abe6-4a80-a155-2ad75479c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f2943-abe6-4a80-a155-2ad75479c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a1d552-98dc-4f1e-aa88-539847d9271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:57 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Volume 59d39ef0-065b-43ca-b622-b5056fc6d173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d39ef0-065b-43ca-b622-b5056fc6d173', 'volume_size': 1} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,created_at=2026-04-02T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296804999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,host='devstack@QuobyteHD#QuobyteHD',id=59d39ef0-065b-43ca-b622-b5056fc6d173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:56:57Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89eed2ee-3eed-41ca-a652-93e58075ff85),volume_type_id=89eed2ee-3eed-41ca-a652-93e58075ff85)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Creating volume 59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:57 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:57 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 1073741824 Apr 02 19:56:57 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:57 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:57 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-69afed97-55ed-4290-a442-581e97e7c52d-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "cinder-69afed97-55ed-4290-a442-581e97e7c52d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Acquiring lock "cinder-quobyte-69afed97-55ed-4290-a442-581e97e7c52d" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "cinder-quobyte-69afed97-55ed-4290-a442-581e97e7c52d" acquired by "delete_volume" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4100249-7346-4840-b7da-0de0c8a5f400]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:57 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d Apr 02 19:56:57 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:57 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 1073741824" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:57 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.590s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:57 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleted volume successfully. Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47cd49af-bae5-4015-8ada-838a0f20d0e4 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-adecbf18-102e-4885-b297-2a6057524bda-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:57 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 Apr 02 19:56:57 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:57 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d" returned: 0 in 0.525s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:58 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d Apr 02 19:56:58 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Deleting offline snapshot 66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 of volume b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] snapshot_file for this snap is: volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd669d-6e42-40df-a368-2165ccfa2011]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:58 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:58 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:58 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-69afed97-55ed-4290-a442-581e97e7c52d" returned: 0 in 0.457s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:58 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173" returned: 0 in 0.544s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "cinder-quobyte-69afed97-55ed-4290-a442-581e97e7c52d" released by "delete_volume" :: held 1.022s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a1d552-98dc-4f1e-aa88-539847d9271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d39ef0-065b-43ca-b622-b5056fc6d173', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cff8de-3e18-433e-8e1c-d95f9555a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:58 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Volume volume-59d39ef0-065b-43ca-b622-b5056fc6d173 (59d39ef0-065b-43ca-b622-b5056fc6d173): created successfully Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cff8de-3e18-433e-8e1c-d95f9555a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (06b725b2-5b28-4d10-84a1-abd6a8195b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2fdfec84-5614-4240-98b9-88f6873e43ce tempest-GroupSnapshotsTest-1191287497 None] Created volume successfully. Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Created reservations ['5a9330ae-5566-40b5-9a95-da9129835173', '2c9f06b6-a787-4af2-821f-2fba32628db4', '84b0b0b2-97c9-4ebf-8e78-1d2218bceca4', 'fa96836a-00f9-4d41-bae4-8018a9b87b59'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:58 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:56:58 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:58 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c8e23-0e59-410a-a27c-2a8b4f320345]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:56:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:58 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:56:58 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:59 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.418s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:56:59 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Deleted volume successfully. Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dc1877e6-1228-43ed-9162-2b755f71eaee tempest-VolumesActionsTest-1512179731 None] Lock "cinder-69afed97-55ed-4290-a442-581e97e7c52d-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:56:59 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:59 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:59 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (14123672-1d87-4687-bcb7-38663f909ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a825e0b0-8401-4037-b544-a7fd6f85321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a825e0b0-8401-4037-b544-a7fd6f85321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280232141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,host='devstack@QuobyteHD#QuobyteHD',id=26b6d7c9-bcff-4a38-b61e-3d595c3263a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:00Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89eed2ee-3eed-41ca-a652-93e58075ff85),volume_type_id=89eed2ee-3eed-41ca-a652-93e58075ff85)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e88f139-bad1-441d-bb84-a622ddb765fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e88f139-bad1-441d-bb84-a622ddb765fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aaf2f6b-b249-477e-a567-da53c12c64bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aaf2f6b-b249-477e-a567-da53c12c64bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b6d7c9-bcff-4a38-b61e-3d595c3263a8', 'volume_name': 'volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c207444-7f70-4871-a99d-09a74e6597d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c207444-7f70-4871-a99d-09a74e6597d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b765b48c-b3e4-4390-a233-256275b3b37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:56:59 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Volume 26b6d7c9-bcff-4a38-b61e-3d595c3263a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8', 'volume_size': 1} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,created_at=2026-04-02T17:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280232141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a88ddc-94be-49b3-b0c2-41697fc603b4,host='devstack@QuobyteHD#QuobyteHD',id=26b6d7c9-bcff-4a38-b61e-3d595c3263a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:00Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89eed2ee-3eed-41ca-a652-93e58075ff85),volume_type_id=89eed2ee-3eed-41ca-a652-93e58075ff85)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Creating volume 26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:56:59 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:59 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 1073741824 Apr 02 19:56:59 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:56:59 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.575s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:56:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:56:59 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5 Apr 02 19:56:59 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:00 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6.66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" returned: 0 in 0.582s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5" released by "_delete_snapshot" :: held 2.231s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" released by "delete_snapshot" :: held 2.256s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['464b2f7f-a404-4eb9-b98a-33170caa93fb', '3be19963-9016-4b09-8470-3cb7658174f0', '6ddc1cbf-428f-4924-98ea-5fcf160374e6', 'c03dd9d7-cdae-490c-9a94-fec2b1c8dea6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Delete snapshot completed successfully. Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-24ed0962-df41-4e75-846e-83ea5307600b tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-66bfbcc7-9f6c-4d58-9a8c-6756a850abc5-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:00 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 1073741824" returned: 0 in 1.020s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:00 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 Apr 02 19:57:00 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:01 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b765b48c-b3e4-4390-a233-256275b3b37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0935ef16-9a3d-48b7-b1f2-955cffc96f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:01 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Volume volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 (26b6d7c9-bcff-4a38-b61e-3d595c3263a8): created successfully Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0935ef16-9a3d-48b7-b1f2-955cffc96f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (14123672-1d87-4687-bcb7-38663f909ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-42094c83-3057-4bba-9067-4c50dcfacc08 tempest-GroupSnapshotsTest-1191287497 None] Created volume successfully. Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-b035214c-4177-4cc7-bb78-bdc9d26f7cf6-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-b035214c-4177-4cc7-bb78-bdc9d26f7cf6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe281089-70dc-483d-9d42-e724b499c2de]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:01 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:57:01 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-560591e6-0f2d-47fb-a28d-7ea5e911be30 tempest-GroupSnapshotsTest-1191287497 None] Update group completed successfully. Apr 02 19:57:02 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.522s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:02 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6 Apr 02 19:57:02 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:02 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" returned: 0 in 0.404s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b035214c-4177-4cc7-bb78-bdc9d26f7cf6" released by "delete_volume" :: held 0.976s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['a323f9c8-2641-459c-97e8-b069ea59fcfb', '3ba6db88-cd85-4105-8647-1c1d239382d7', '6a052234-2b72-466d-b98c-d3aa79187c3d', '07a9a04f-dc91-4ec0-891b-d28406d272d4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:02 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:02 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53fa81-819d-458e-8e52-841f4ad5ebb6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:02 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f Apr 02 19:57:02 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e18955c3-e98d-4953-9162-9508960d4b10 tempest-GroupSnapshotsTest-1191287497 None] Update group completed successfully. Apr 02 19:57:03 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.727s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleted volume successfully. Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fe6c9210-b6b1-49db-8607-6031803c33d9 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-b035214c-4177-4cc7-bb78-bdc9d26f7cf6-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:03 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" returned: 0 in 0.642s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:03 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f Apr 02 19:57:03 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:03 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" returned: 0 in 0.506s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-quobyte-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f" released by "delete_volume" :: held 1.196s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:03 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Created reservations ['fea97589-ada0-44f6-aec2-df5acb37024b', 'f4129761-602a-4537-ac99-5fe660b51a71', '303de860-a327-475d-9f9e-6a13a5dd7806', '15aa3475-5526-4c27-bcf1-5ff1eb3cc05b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:04 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:04 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:04 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ecf9cf95-43fb-4570-9201-a5ba5bd9b2dc tempest-GroupSnapshotsTest-1191287497 None] Update group completed successfully. Apr 02 19:57:04 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.440s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:04 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Deleted volume successfully. Apr 02 19:57:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5147be04-e210-4206-acee-182614a56923 tempest-VolumesSnapshotTestJSON-1706075825 None] Lock "cinder-b5ab8564-ac95-4d6d-8f31-0e15cf650b7f-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:05 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-dbde3810-fad4-4772-b35d-f6e3b63a5f45 tempest-GroupSnapshotsTest-1191287497 None] Update group completed successfully. Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:06 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:06 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] GroupSnapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: creating. Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Group snapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: creating. {{(pid=82597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Creating offline snapshot 86e48363-0b88-4dab-8460-be323b1a2b31 of volume 59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e153f88-9a5d-474c-8e6d-176a03b10b39]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:07 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 Apr 02 19:57:07 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:07 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.596s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:07 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173" returned: 0 in 0.560s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:07 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 1G Apr 02 19:57:07 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:08 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 1G" returned: 0 in 0.739s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d39ef0-065b-43ca-b622-b5056fc6d173 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:08 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d39ef0-065b-43ca-b622-b5056fc6d173 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 Apr 02 19:57:08 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Flow 'volume_create_manager' (af08578d-c4fa-4f93-807f-8bdf00b222f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6359dc06-b30a-4f3e-a02d-565977df50f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:09 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6359dc06-b30a-4f3e-a02d-565977df50f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-460018930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3c3b3f-1291-466e-b8e1-59577fee5c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aed53e04d64ee0a13a8cdd5648a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:09Z,use_quota=True,user_id='0c0c386d518c41f2a1f6b22614fff6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb1fee9-2e33-4141-91b6-0b7fcb6b09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb1fee9-2e33-4141-91b6-0b7fcb6b09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f4956a-f60d-48a9-b314-8aa5d5eae766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.image.glance [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Creating Keystone auth plugin from conf {{(pid=82597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59d39ef0-065b-43ca-b622-b5056fc6d173 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31" returned: 0 in 0.961s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:09 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:09 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 Apr 02 19:57:09 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:09 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f4956a-f60d-48a9-b314-8aa5d5eae766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd3c3b3f-1291-466e-b8e1-59577fee5c3a', 'volume_name': 'volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4954325d-4fcb-4231-8c29-74f0f8cf98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4954325d-4fcb-4231-8c29-74f0f8cf98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6f4f4-4b2a-40ce-8125-f53e6b7dbc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Trying to clone cd3c3b3f-1291-466e-b8e1-59577fee5c3a from image 9973ca61-39fa-459d-874e-a0e627b97de3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]). {{(pid=82597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 19:57:09 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info Apr 02 19:57:09 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:09 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 19:57:09 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Image download 20.69 MB at 20.69 MB/s Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd557f-69ac-421b-ad06-1f727b35de0d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:10 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD Apr 02 19:57:10 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:10 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info" returned: 0 in 0.560s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:10 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:10 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info Apr 02 19:57:10 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:10 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD" returned: 0 in 0.552s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 is fetched for user 0c0c386d518c41f2a1f6b22614fff6b6. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Flow 'volume_create_manager' (f0f71895-8bb5-48fd-8a89-93abcfacde04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe8e8a-6b96-44f6-a062-910758ebf53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe8e8a-6b96-44f6-a062-910758ebf53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1264807486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd5706-6ab3-47d3-9bfc-5a7b22b0b662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6a65809aa547f78fbba45ef7719270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:11Z,use_quota=True,user_id='a73fb0ed010e47aeaaef881e6e260331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0bc6d-020b-4559-a83d-5efc47f92d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0bc6d-020b-4559-a83d-5efc47f92d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd5dc94-b59f-46bd-9956-40a23c97db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd5dc94-b59f-46bd-9956-40a23c97db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67dd5706-6ab3-47d3-9bfc-5a7b22b0b662', 'volume_name': 'volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b586f42-543e-42dd-b324-4f6545f5e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b586f42-543e-42dd-b324-4f6545f5e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453e22a7-f3d9-4b88-b6a1-2919519830cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662', 'volume_size': 1} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c644df3d-2e82-427c-a1c6-ebbd7eb20d37]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:10 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.info" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.841s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Creating offline snapshot 88a0e7d4-d660-499c-830f-aff336cbf502 of volume 26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:10 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD Apr 02 19:57:10 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b203e-9aeb-40bd-ba2c-839789536b5a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:10 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 Apr 02 19:57:10 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:11 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:11 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:11 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 1G Apr 02 19:57:11 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:11 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 1G" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:11 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 Apr 02 19:57:11 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:12 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:12 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:12 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 Apr 02 19:57:12 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:12 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502" returned: 0 in 0.395s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:12 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info Apr 02 19:57:12 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:12 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info" returned: 0 in 0.422s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:12 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:13 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info Apr 02 19:57:13 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:13 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.info" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.762s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1264807486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd5706-6ab3-47d3-9bfc-5a7b22b0b662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6a65809aa547f78fbba45ef7719270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:11Z,use_quota=True,user_id='a73fb0ed010e47aeaaef881e6e260331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Creating volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:13 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:13 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 1073741824 Apr 02 19:57:13 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ef3e4833-b4de-4d8b-a0c3-35bec7180c44 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: created successfully Apr 02 19:57:13 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 1073741824" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:13 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 Apr 02 19:57:13 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: deleting Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=206,cinder:SELECT=199,cinder:INSERT=54,cinder:DELETE=13 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=177,cinder:INSERT=48,cinder:UPDATE=231,cinder:DELETE=18 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: deleting {{(pid=82597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-86e48363-0b88-4dab-8460-be323b1a2b31" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-86e48363-0b88-4dab-8460-be323b1a2b31" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Deleting offline snapshot 86e48363-0b88-4dab-8460-be323b1a2b31 of volume 59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:14 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] snapshot_file for this snap is: volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" returned: 0 in 0.485s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[85813180-272c-4e44-9739-391e3ad757a1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.279s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-460018930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3c3b3f-1291-466e-b8e1-59577fee5c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1aed53e04d64ee0a13a8cdd5648a6fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:09Z,use_quota=True,user_id='0c0c386d518c41f2a1f6b22614fff6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Creating volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:14 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1073741824 Apr 02 19:57:14 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453e22a7-f3d9-4b88-b6a1-2919519830cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f4e135-b1e5-4c47-b78c-720f4583e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Volume volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 (67dd5706-6ab3-47d3-9bfc-5a7b22b0b662): created successfully Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f4e135-b1e5-4c47-b78c-720f4583e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Flow 'volume_create_manager' (f0f71895-8bb5-48fd-8a89-93abcfacde04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f2246174-be3d-47d8-ad62-f39f5a4935fd tempest-VolumesSnapshotListTestJSON-176150064 None] Created volume successfully. Apr 02 19:57:14 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 Apr 02 19:57:14 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:15 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31" returned: 0 in 0.672s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59d39ef0-065b-43ca-b622-b5056fc6d173(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8aaac6-1803-4aa9-84e7-f05524d62266]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:15 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1073741824" returned: 0 in 0.770s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:15 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 Apr 02 19:57:15 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:15 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:15 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:15 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173" returned: 0 in 0.599s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:15 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 Apr 02 19:57:15 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:15 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 0 in 0.557s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Creating offline snapshot ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac062889-3ef3-49f5-8e42-8a5ddc57f1e3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Attempting download of 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e5b01-ecd7-41d8-a65f-108b480aaadc]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:15 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 Apr 02 19:57:15 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:16 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi Apr 02 19:57:16 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:16 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:16 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31 Apr 02 19:57:16 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:16 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:16 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 1G Apr 02 19:57:16 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:16 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi" returned: 0 in 0.628s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:16 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173.86e48363-0b88-4dab-8460-be323b1a2b31" returned: 0 in 0.407s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-86e48363-0b88-4dab-8460-be323b1a2b31" released by "_delete_snapshot" :: held 2.284s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" released by "delete_snapshot" :: held 2.295s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:16 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi Apr 02 19:57:16 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-88a0e7d4-d660-499c-830f-aff336cbf502" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-88a0e7d4-d660-499c-830f-aff336cbf502" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Deleting offline snapshot 88a0e7d4-d660-499c-830f-aff336cbf502 of volume 26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] snapshot_file for this snap is: volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc844c5-e5c9-4805-b36f-12817a3cd6da]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:16 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 Apr 02 19:57:16 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:17 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 1G" returned: 0 in 0.674s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:17 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:17 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:17 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi" returned: 1 in 0.696s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_rfnctrmi' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[64869acc-a9fb-42fd-a4f7-634e54b5da25]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:17 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD Apr 02 19:57:17 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:17 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502" returned: 0 in 0.677s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625eb7c-393f-4b36-bcd5-9127bd7a476c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:17 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 Apr 02 19:57:17 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:17 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:17 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 is being set with open permissions: ugo+rw Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:17 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:17 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:17 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] 9973ca61-39fa-459d-874e-a0e627b97de3 was qcow2, converting to raw {{(pid=82597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 19:57:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:17 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:17 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:18 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" returned: 0 in 0.498s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:18 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.421s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:18 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 Apr 02 19:57:18 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:18 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info Apr 02 19:57:18 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:18 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502" returned: 0 in 0.780s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:18 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502 Apr 02 19:57:18 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:18 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info" returned: 0 in 0.800s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:18 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info is being set with open permissions: ugo+rw Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:18 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 0 in 1.113s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_cg9mjsc0devstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:57:18 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Converted 112.00 MB image at 100.45 MB/s Apr 02 19:57:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:18 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info Apr 02 19:57:18 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:18 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1G Apr 02 19:57:18 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:19 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8.88a0e7d4-d660-499c-830f-aff336cbf502" returned: 0 in 0.422s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-88a0e7d4-d660-499c-830f-aff336cbf502" released by "_delete_snapshot" :: held 2.449s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" released by "delete_snapshot" :: held 2.462s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:19 devstack cinder-volume[82597]: WARNING cinder.quota [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-775345873 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-775345873, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:19 devstack cinder-volume[82597]: WARNING cinder.quota [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-775345873 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-775345873, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['cd85aab1-a204-4647-9903-2ed3669c7fda', '385962de-082f-4dd7-bdf4-9bebc154c179', '75f0125e-1d9d-46d8-b324-8aa875350dfe', 'ff8e52bc-d221-4418-8719-7d9c9c710e40'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['a1a69618-aa7e-4c10-a4ec-2e8f9d232bd0', 'e0b20ed9-3967-4d37-9f58-111e2bc368b2', '064a55c5-794b-4af6-8ede-bf28723ffa12', '06b22d02-38c4-4e2f-954f-9a7e14a3f408'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:19 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a 1G" returned: 0 in 0.473s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:19 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.info" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.627s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[918e2657-37c6-432d-8eec-f5a98c4c0d57]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:19 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3bf2f67c-03ba-4d7f-a866-f7467faf2413 tempest-VolumesSnapshotListTestJSON-176150064 None] Create snapshot completed successfully Apr 02 19:57:19 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8d0e472e-7180-48f7-864c-e2cabfe4e6c3 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot 13d2c849-0ba1-4ee2-aa60-d7d4da9237ee: deleted successfully Apr 02 19:57:19 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:19 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" acquired by "delete_volume" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79b312-d452-4323-9307-f0affdd6d3a3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:20 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 0 in 0.606s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:20 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 Apr 02 19:57:20 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:20 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:20 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Creating offline snapshot 6fd69e77-d820-4f1f-9b06-59f40ebf268d of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b4fc6-dde9-4379-807b-f0d2e3e3962f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:20 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:20 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:20 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" returned: 0 in 0.688s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:20 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 1 in 0.676s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Downloaded image 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a successfully. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 19:57:20 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8 Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 for user 0c0c386d518c41f2a1f6b22614fff6b6 is deleted. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Marking volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a as bootable. {{(pid=82597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 19:57:20 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Copying metadata from image 9973ca61-39fa-459d-874e-a0e627b97de3 to cd3c3b3f-1291-466e-b8e1-59577fee5c3a. {{(pid=82597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Creating volume glance metadata for volume cd3c3b3f-1291-466e-b8e1-59577fee5c3a backed by image 9973ca61-39fa-459d-874e-a0e627b97de3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6f4f4-4b2a-40ce-8125-f53e6b7dbc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0772fd-1719-4e0a-a7f7-c9d30152c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:20 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Volume volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a (cd3c3b3f-1291-466e-b8e1-59577fee5c3a): created successfully Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0772fd-1719-4e0a-a7f7-c9d30152c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Flow 'volume_create_manager' (af08578d-c4fa-4f93-807f-8bdf00b222f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6aa5408e-80f8-4f4b-a578-5604ff514588 tempest-VolumesImageMetadata-1058393079 None] Created volume successfully. Apr 02 19:57:21 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.672s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:21 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d 1G Apr 02 19:57:21 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:21 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" returned: 0 in 0.681s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-26b6d7c9-bcff-4a38-b61e-3d595c3263a8" released by "delete_volume" :: held 1.419s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce740b9d-fe94-41ed-a6d9-e26c72559def]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:21 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 Apr 02 19:57:21 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:21 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d 1G" returned: 0 in 0.645s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:21 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:21 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:21 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:21 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173 Apr 02 19:57:21 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Acquiring lock "cinder-cd3c3b3f-1291-466e-b8e1-59577fee5c3a-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "cinder-cd3c3b3f-1291-466e-b8e1-59577fee5c3a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Acquiring lock "cinder-quobyte-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "cinder-quobyte-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:22 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.605s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:22 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d is being set with open permissions: ugo+rw Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59b66dc-ffa8-47e2-a736-48e0a6ea3e1a]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:22 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:22 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:22 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:22 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:22 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-59d39ef0-065b-43ca-b622-b5056fc6d173" returned: 0 in 0.580s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-59d39ef0-065b-43ca-b622-b5056fc6d173" released by "delete_volume" :: held 1.098s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['fbb4c7d3-2ad1-44a8-bda7-194c16ec38ad'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:22 devstack cinder-volume[82597]: WARNING cinder.quota [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-775345873 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-775345873, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['d9251c3a-1b8c-40de-b4b2-a5c1e375dcf7', 'e1f61d78-6ed3-41e9-ab44-c23f349b9c17', '10e0a10f-f5be-4ad4-8095-c6d469cfa0da', 'f0310999-4cdb-4a8d-8877-ed35ef51b314'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['e4a800b8-b6c6-4fda-9d23-42d9e6ea2263', '705933ff-c9c1-4f87-869c-0aca811d2c46', '45c3e2e7-9428-4c20-8997-e4ed589e4a4c', '691ee866-9ae6-4c47-b68d-52708035fcb1'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:22 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:22 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:22 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.519s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8bd47de8-41c5-4064-8eab-974ee1b540f7 tempest-VolumesSnapshotListTestJSON-176150064 None] Create snapshot completed successfully Apr 02 19:57:22 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 0 in 0.564s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:22 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:22 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:23 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4fba442b-c8c5-45c3-b0dd-4e5a14dc698a tempest-GroupSnapshotsTest-1191287497 None] Delete group completed successfully. Apr 02 19:57:23 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 1 in 0.528s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:23 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a Apr 02 19:57:23 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Creating offline snapshot 46dc7db4-79f4-48fe-ae01-2a4deadcef27 of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcac33-77e3-4309-9a47-c6279a8e6562]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fdc5b098-3c97-473b-932c-774b37b74871 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-726964731: creating Apr 02 19:57:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fdc5b098-3c97-473b-932c-774b37b74871 tempest-GroupSnapshotsTest-1191287497 None] Group tempest-GroupSnapshotsTest-Group-726964731: created successfully Apr 02 19:57:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fdc5b098-3c97-473b-932c-774b37b74871 tempest-GroupSnapshotsTest-1191287497 None] Create group completed successfully. Apr 02 19:57:23 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:23 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:23 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "cinder-quobyte-cd3c3b3f-1291-466e-b8e1-59577fee5c3a" released by "delete_volume" :: held 1.612s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Created reservations ['98292fb3-a7ac-499d-872c-d39134f1c13b', '5be85924-cea1-4188-9ab5-12a86203cf7b', '96e02c3d-a1da-4af0-a4ec-a3cb3c40d916', '794ddc73-0ae3-4667-b403-204872e587c6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:23 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:23 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:24 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:24 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 1G Apr 02 19:57:24 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:24 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Deleted volume successfully. Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c297958e-dda2-4c72-b52c-e159693886d1 tempest-VolumesImageMetadata-1058393079 None] Lock "cinder-cd3c3b3f-1291-466e-b8e1-59577fee5c3a-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:24 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 1G" returned: 0 in 0.644s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:24 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 Apr 02 19:57:24 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:24 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (874a7c98-a225-4e0d-a0bb-46a93d51dad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed92ee-faa2-4ee2-a7fc-aa1f619673e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed92ee-faa2-4ee2-a7fc-aa1f619673e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152947858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da3ad4f4-816c-4c02-b415-53b45ce808e4,host='devstack@QuobyteHD#QuobyteHD',id=0c9fe645-0649-442f-b09f-428b07dd0e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:25Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbd75fd4-bab6-442b-b7f0-7cd686931cdc),volume_type_id=fbd75fd4-bab6-442b-b7f0-7cd686931cdc)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e500216-377f-45d5-ad63-db458cd39035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e500216-377f-45d5-ad63-db458cd39035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6cd109-b130-42ba-9a20-9665160bd2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6cd109-b130-42ba-9a20-9665160bd2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9fe645-0649-442f-b09f-428b07dd0e99', 'volume_name': 'volume-0c9fe645-0649-442f-b09f-428b07dd0e99', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f0b784-ea10-4c90-aa71-bafd5f1424e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f0b784-ea10-4c90-aa71-bafd5f1424e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b292a23-c4e3-4d98-a88f-a533b8e535cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:25 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Volume 0c9fe645-0649-442f-b09f-428b07dd0e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9fe645-0649-442f-b09f-428b07dd0e99', 'volume_size': 1} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:25 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27" returned: 0 in 0.533s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:25 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 is being set with open permissions: ugo+rw Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:25 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 Apr 02 19:57:25 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:25 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27" returned: 0 in 0.443s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da3ad4f4-816c-4c02-b415-53b45ce808e4,created_at=2026-04-02T17:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152947858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da3ad4f4-816c-4c02-b415-53b45ce808e4,host='devstack@QuobyteHD#QuobyteHD',id=0c9fe645-0649-442f-b09f-428b07dd0e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e744f611338f497cb3e09f26a2b587f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:25Z,use_quota=True,user_id='9da1dbe4cafe412785b5ad2e3344528b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbd75fd4-bab6-442b-b7f0-7cd686931cdc),volume_type_id=fbd75fd4-bab6-442b-b7f0-7cd686931cdc)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Creating volume 0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:25 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:25 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 1073741824 Apr 02 19:57:25 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-487f3081-95e5-4f92-960a-9af0664a76bb tempest-VolumesSnapshotListTestJSON-176150064 None] Create snapshot completed successfully Apr 02 19:57:26 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 1073741824" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:26 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 Apr 02 19:57:26 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Flow 'volume_create_manager' (7f2c217c-6674-4422-86b0-eacd01887f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04e94a-559b-464f-8a9b-6487ded0488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04e94a-559b-464f-8a9b-6487ded0488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1945345908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d617a93a-d1a3-435b-b4d5-acdd45fde54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b49fbe489043cf8cca0abd34dcc641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:27Z,use_quota=True,user_id='fd17d46aff634d1ca3e9b6cc56597388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467da547-2b7d-4255-9457-06e8ccf666f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467da547-2b7d-4255-9457-06e8ccf666f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caab46ec-a68c-4f28-83c8-8887d6728fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caab46ec-a68c-4f28-83c8-8887d6728fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd617a93a-d1a3-435b-b4d5-acdd45fde54f', 'volume_name': 'volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5502405d-0ec3-4c16-9e17-03c10b965c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5502405d-0ec3-4c16-9e17-03c10b965c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625fe4b0-99fe-4801-b164-c282192a5f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Volume d617a93a-d1a3-435b-b4d5-acdd45fde54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f', 'volume_size': 1} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1945345908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d617a93a-d1a3-435b-b4d5-acdd45fde54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b49fbe489043cf8cca0abd34dcc641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:27Z,use_quota=True,user_id='fd17d46aff634d1ca3e9b6cc56597388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Creating volume d617a93a-d1a3-435b-b4d5-acdd45fde54f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:26 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b292a23-c4e3-4d98-a88f-a533b8e535cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9fe645-0649-442f-b09f-428b07dd0e99', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec0f4b2-ccd5-4b3f-b94c-e594b5d4be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:26 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Volume volume-0c9fe645-0649-442f-b09f-428b07dd0e99 (0c9fe645-0649-442f-b09f-428b07dd0e99): created successfully Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec0f4b2-ccd5-4b3f-b94c-e594b5d4be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Flow 'volume_create_manager' (874a7c98-a225-4e0d-a0bb-46a93d51dad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:26 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f 1073741824 Apr 02 19:57:26 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:26 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-651f5872-5924-4339-89d2-62f28f5a0959 tempest-GroupSnapshotsTest-1191287497 None] Created volume successfully. Apr 02 19:57:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] GroupSnapshot dc2d5d58-eae1-45b8-882b-497b62890a51: creating. Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-46dc7db4-79f4-48fe-ae01-2a4deadcef27-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-46dc7db4-79f4-48fe-ae01-2a4deadcef27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Group snapshot dc2d5d58-eae1-45b8-882b-497b62890a51: creating. {{(pid=82597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-46dc7db4-79f4-48fe-ae01-2a4deadcef27" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-46dc7db4-79f4-48fe-ae01-2a4deadcef27" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Deleting offline snapshot 46dc7db4-79f4-48fe-ae01-2a4deadcef27 of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] snapshot_file for this snap is: volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e280ec-37c1-4cea-a5db-a6c36bddd901]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:27 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f 1073741824" returned: 0 in 0.652s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:27 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 Apr 02 19:57:27 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:27 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f Apr 02 19:57:27 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:28 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.624s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625fe4b0-99fe-4801-b164-c282192a5f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f5ae78-dcf9-406b-90bf-349964ca93a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Creating offline snapshot 7533851a-efc6-43f6-8dc3-4e5816d9837b of volume 0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Volume volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f (d617a93a-d1a3-435b-b4d5-acdd45fde54f): created successfully Apr 02 19:57:28 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f5ae78-dcf9-406b-90bf-349964ca93a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Flow 'volume_create_manager' (7f2c217c-6674-4422-86b0-eacd01887f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d0f20-1177-4a3c-adbe-f71bc9c4eb1f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27" returned: 0 in 0.659s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ce749632-669f-42f7-8e87-4dc5c081980c tempest-AbsoluteLimitsTests-838325514 None] Created volume successfully. Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2143f57d-4d15-479e-b426-2413ded04b58]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:28 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 Apr 02 19:57:28 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:28 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:28 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:28 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99" returned: 0 in 0.498s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:28 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b 1G Apr 02 19:57:28 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:28 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.552s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:28 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 Apr 02 19:57:28 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Acquiring lock "cinder-d617a93a-d1a3-435b-b4d5-acdd45fde54f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "cinder-d617a93a-d1a3-435b-b4d5-acdd45fde54f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Acquiring lock "cinder-quobyte-d617a93a-d1a3-435b-b4d5-acdd45fde54f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "cinder-quobyte-d617a93a-d1a3-435b-b4d5-acdd45fde54f" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a8d668-89c7-40f7-8cdb-a25d64bce0b9]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:29 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f Apr 02 19:57:29 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:29 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b 1G" returned: 0 in 0.554s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9fe645-0649-442f-b09f-428b07dd0e99 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:29 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9fe645-0649-442f-b09f-428b07dd0e99 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b Apr 02 19:57:29 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:29 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27" returned: 0 in 0.567s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:29 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27 Apr 02 19:57:29 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:29 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f" returned: 0 in 0.522s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:29 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f Apr 02 19:57:29 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:29 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c9fe645-0649-442f-b09f-428b07dd0e99 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b" returned: 0 in 0.442s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:29 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b Apr 02 19:57:29 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:29 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.46dc7db4-79f4-48fe-ae01-2a4deadcef27" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-46dc7db4-79f4-48fe-ae01-2a4deadcef27" released by "_delete_snapshot" :: held 2.318s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" released by "delete_snapshot" :: held 2.334s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Created reservations ['5b02d4ff-46b8-4ef6-afb5-f53a906f3768', '32b76122-aea1-4d56-b094-a1f8f4910f90', 'ef1ba1fd-774a-43c2-9c22-e3c24a03d55c', 'e76936b9-da93-4863-bb36-a8d925a0099b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Delete snapshot completed successfully. Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2aedd674-b0de-4f51-a013-c06069aa6656 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-46dc7db4-79f4-48fe-ae01-2a4deadcef27-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:29 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d617a93a-d1a3-435b-b4d5-acdd45fde54f" returned: 0 in 0.402s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "cinder-quobyte-d617a93a-d1a3-435b-b4d5-acdd45fde54f" released by "delete_volume" :: held 0.946s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:29 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Created reservations ['0a817020-1e20-4bb7-bb5d-bb3ebedf2f7a', '3dd682ef-8d87-4111-ad92-f4d36a111963', '5b2aae6c-3fb3-42f6-aba9-9bd14ce2e96f', '1c78eebf-3c4b-409e-92a9-9ed6fa97bd9c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:30 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:30 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info Apr 02 19:57:30 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:30 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:30 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:30 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:30 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-6fd69e77-d820-4f1f-9b06-59f40ebf268d-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:30 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-6fd69e77-d820-4f1f-9b06-59f40ebf268d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:30 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:30 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-6fd69e77-d820-4f1f-9b06-59f40ebf268d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.522s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Deleted volume successfully. Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-6fd69e77-d820-4f1f-9b06-59f40ebf268d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Deleting offline snapshot 6fd69e77-d820-4f1f-9b06-59f40ebf268d of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] snapshot_file for this snap is: volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efc655e-3be6-4d00-b625-057ad4e5297d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-af557b42-e1f3-4ccf-8eb5-28f529a0cf85 tempest-AbsoluteLimitsTests-838325514 None] Lock "cinder-d617a93a-d1a3-435b-b4d5-acdd45fde54f-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:30 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:30 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:31 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.info" returned: 0 in 0.591s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:31 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.512s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f8e95-ba5e-4d67-b82e-3c0a05b74bb6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:31 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-813886c6-627b-49eb-805e-39692040b128 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot dc2d5d58-eae1-45b8-882b-497b62890a51: created successfully Apr 02 19:57:31 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:31 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:31 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot dc2d5d58-eae1-45b8-882b-497b62890a51: deleting Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot dc2d5d58-eae1-45b8-882b-497b62890a51: deleting {{(pid=82597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-7533851a-efc6-43f6-8dc3-4e5816d9837b" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-7533851a-efc6-43f6-8dc3-4e5816d9837b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Deleting offline snapshot 7533851a-efc6-43f6-8dc3-4e5816d9837b of volume 0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] snapshot_file for this snap is: volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba88b02f-a96a-42a4-8acd-bf364164245b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:31 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.626s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:31 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:31 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:31 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b Apr 02 19:57:31 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:32 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b" returned: 0 in 0.539s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c9fe645-0649-442f-b09f-428b07dd0e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ba79a-00aa-4265-86a5-1541bb8d8ab8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:32 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.600s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:32 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 Apr 02 19:57:32 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d Apr 02 19:57:32 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:32 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:32 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.6fd69e77-d820-4f1f-9b06-59f40ebf268d" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-6fd69e77-d820-4f1f-9b06-59f40ebf268d" released by "_delete_snapshot" :: held 2.236s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" released by "delete_snapshot" :: held 2.266s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:32 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:32 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b Apr 02 19:57:32 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:32 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Created reservations ['afe0f0ed-5932-46e7-ac80-eab38d1c1f09', '6fbde40e-e3d2-4bde-8a30-3fed34a0c633', 'dd0739c1-785c-43c8-aa86-a58ca1d7dea5', '1095d2e5-b47f-4e57-8fe0-c39390b5e715'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Delete snapshot completed successfully. Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-992db2cd-d0de-49e0-9f62-facdefb8b211 tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-6fd69e77-d820-4f1f-9b06-59f40ebf268d-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:33 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b" returned: 0 in 0.700s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:33 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b Apr 02 19:57:33 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Deleting offline snapshot ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 of volume 67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] snapshot_file for this snap is: volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe67d8a-1552-40a2-996c-5ca3abc7e8f8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:34 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:34 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Flow 'volume_create_manager' (3df7f8c4-f716-4f9a-992c-23d5f09e5617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1821c55d-ba47-4115-9538-3f7ee5594cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1821c55d-ba47-4115-9538-3f7ee5594cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-776760515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c1567-42bc-43c9-b310-ae033f369de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e4b03d46ae43a1b946c0848a0e068c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:34Z,use_quota=True,user_id='8a1f3da38870466c91570c778c48b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a20ca81-3912-4175-b84a-9c21a79b9058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a20ca81-3912-4175-b84a-9c21a79b9058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afb51d-b42f-4559-a06e-1f8d777c3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afb51d-b42f-4559-a06e-1f8d777c3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5c1567-42bc-43c9-b310-ae033f369de8', 'volume_name': 'volume-7d5c1567-42bc-43c9-b310-ae033f369de8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb81d7a-cd92-4885-8698-7a706063308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb81d7a-cd92-4885-8698-7a706063308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7559cdf1-602d-432b-b942-0c9239fc9f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Volume 7d5c1567-42bc-43c9-b310-ae033f369de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5c1567-42bc-43c9-b310-ae033f369de8', 'volume_size': 1} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-776760515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c1567-42bc-43c9-b310-ae033f369de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e4b03d46ae43a1b946c0848a0e068c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:34Z,use_quota=True,user_id='8a1f3da38870466c91570c778c48b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Creating volume 7d5c1567-42bc-43c9-b310-ae033f369de8 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:34 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:34 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 1073741824 Apr 02 19:57:34 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:34 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99.7533851a-efc6-43f6-8dc3-4e5816d9837b" returned: 0 in 0.780s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-7533851a-efc6-43f6-8dc3-4e5816d9837b" released by "_delete_snapshot" :: held 2.622s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" released by "delete_snapshot" :: held 2.635s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:34 devstack cinder-volume[82597]: WARNING cinder.quota [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-24309521 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-24309521, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:34 devstack cinder-volume[82597]: WARNING cinder.quota [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-24309521 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-24309521, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['15a528ed-17de-45fc-93a7-564ea13922d3', 'd3f75e0d-140e-406b-80d9-a5004d15cba8', '44433b9e-3ac3-4482-9f7d-f034ed8da9d5', '9df973fa-982c-4b9a-9fdd-e9458f4b5c9e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:34 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e86882-96a7-417b-9fcb-2b2d1fd0b1cb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9c6252bb-2432-47b8-845c-66be512a8f18 tempest-GroupSnapshotsTest-1191287497 None] group_snapshot dc2d5d58-eae1-45b8-882b-497b62890a51: deleted successfully Apr 02 19:57:34 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 Apr 02 19:57:34 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:34 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 1073741824" returned: 0 in 0.550s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:34 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 Apr 02 19:57:34 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:35 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:35 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:35 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:35 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8" returned: 0 in 0.589s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7559cdf1-602d-432b-b942-0c9239fc9f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5c1567-42bc-43c9-b310-ae033f369de8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9c32f7-cc41-4ec4-a8f6-fd1eed483b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:35 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Volume volume-7d5c1567-42bc-43c9-b310-ae033f369de8 (7d5c1567-42bc-43c9-b310-ae033f369de8): created successfully Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9c32f7-cc41-4ec4-a8f6-fd1eed483b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Flow 'volume_create_manager' (3df7f8c4-f716-4f9a-992c-23d5f09e5617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:35 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7c1c9f73-cee8-4767-8f29-b0df4f5bd047 tempest-VolumesTransfersV355Test-659524190 None] Created volume successfully. Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" acquired by "delete_volume" :: waited 0.034s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e092dbf3-1fad-4855-bb94-aad7b192e17b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:35 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 Apr 02 19:57:35 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:35 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.812s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:35 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0 Apr 02 19:57:35 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:36 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99" returned: 0 in 0.760s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:36 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99 Apr 02 19:57:36 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:36 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662.ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" returned: 0 in 0.544s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0" released by "_delete_snapshot" :: held 2.611s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" released by "delete_snapshot" :: held 2.623s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Created reservations ['f92c9f98-2389-4bd7-906d-f79022aea129', 'cb88b7b9-fb5b-4827-a210-002b8f586853', '4093e55c-75d6-4662-8a58-0f2b791e005a', '3c8d1722-4e19-4553-84c6-d9c2904ecd51'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:36 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Delete snapshot completed successfully. Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2bbfc082-4afa-4bd4-9464-67e934f76c6c tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-ac5f9b45-fc4d-4f3d-a76d-69064df3f6e0-delete_snapshot" released by "delete_snapshot" :: held 2.757s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:36 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-275402eb-2dee-4802-a10c-f855c3bfe599 tempest-VolumesTransfersV355Test-2098482534 None] Transfer volume completed successfully. Apr 02 19:57:36 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c9fe645-0649-442f-b09f-428b07dd0e99" returned: 0 in 0.535s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Lock "cinder-quobyte-0c9fe645-0649-442f-b09f-428b07dd0e99" released by "delete_volume" :: held 1.328s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['be8d0ff0-887a-4496-af1d-bd60e5992b9b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:36 devstack cinder-volume[82597]: WARNING cinder.quota [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-24309521 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-24309521, it is now deprecated. Please use the default quota class for default quota. Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Created reservations ['3c1d5463-2a7e-4055-939d-6288f6c17c84', '180905db-e2e9-4627-92b9-c04aa5d792a2', '573c7e66-c510-43f5-b4b4-a603d513faf4', '2c88eb70-5f6b-4e22-bf74-63817c5b40a3'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:36 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:36 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633b1d2-16a1-40fc-8db1-144d9250046f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:37 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 Apr 02 19:57:37 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "cinder-7d5c1567-42bc-43c9-b310-ae033f369de8-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-7d5c1567-42bc-43c9-b310-ae033f369de8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:37 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.614s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f8e0256a-3003-409a-b16e-3f748aba62d6 tempest-GroupSnapshotsTest-1191287497 None] Delete group completed successfully. Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "cinder-quobyte-7d5c1567-42bc-43c9-b310-ae033f369de8" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-quobyte-7d5c1567-42bc-43c9-b310-ae033f369de8" acquired by "delete_volume" :: waited 0.034s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc72d7-0a7a-4c83-a1e2-d3c80a971abe]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:37 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" returned: 0 in 0.652s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:37 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 Apr 02 19:57:37 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:37 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662 Apr 02 19:57:37 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:38 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-quobyte-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662" released by "delete_volume" :: held 1.274s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:38 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8" returned: 0 in 0.758s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Created reservations ['bd1b1e48-dd02-4810-88bc-17917c5e5639', 'ce732dc7-afd7-4564-b948-2363333613d8', '91f143d9-f6f4-4bef-a6dc-8809be4938e8', '5849a363-ca05-4a50-b60c-548376351b1a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:38 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8 Apr 02 19:57:38 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:38 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:38 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:38 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7d5c1567-42bc-43c9-b310-ae033f369de8" returned: 0 in 0.518s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-quobyte-7d5c1567-42bc-43c9-b310-ae033f369de8" released by "delete_volume" :: held 1.316s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:38 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Created reservations ['4a01175b-89c2-4858-849d-ff859d4128cc', 'e3fc8e4d-72b7-48dc-a0b3-54e1be209e6e', '74b7aca1-2b31-45b2-a0d0-b0df4d11a053', 'fa863075-2cfa-497f-93a8-cf566da9f035'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:39 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.531s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:39 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Deleted volume successfully. Apr 02 19:57:39 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6f2cade5-ab36-40cc-8103-9551566b229d tempest-VolumesSnapshotListTestJSON-176150064 None] Lock "cinder-67dd5706-6ab3-47d3-9bfc-5a7b22b0b662-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:39 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:39 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:39 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Deleted volume successfully. Apr 02 19:57:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-73e3d9c4-6b52-4eda-a82d-e1899aafec85 tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-7d5c1567-42bc-43c9-b310-ae033f369de8-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Flow 'volume_create_manager' (e6832757-5e6a-4bf6-92cf-1084a004d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93dc66a-f810-4c50-a2aa-f00cdb67168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93dc66a-f810-4c50-a2aa-f00cdb67168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1580054140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9aafd7-af44-41a1-bd57-49a44f805e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e4b03d46ae43a1b946c0848a0e068c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:40Z,use_quota=True,user_id='8a1f3da38870466c91570c778c48b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb5478e-b31e-4a0c-8ebe-aedd100df937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb5478e-b31e-4a0c-8ebe-aedd100df937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23ff3b9-ec80-4046-8138-f993f7945223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23ff3b9-ec80-4046-8138-f993f7945223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9aafd7-af44-41a1-bd57-49a44f805e60', 'volume_name': 'volume-2f9aafd7-af44-41a1-bd57-49a44f805e60', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6db0a49-444a-449c-9b3a-821f0df78865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6db0a49-444a-449c-9b3a-821f0df78865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44023ec-bec9-4ea5-b166-8b8c92483395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:40 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Volume 2f9aafd7-af44-41a1-bd57-49a44f805e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9aafd7-af44-41a1-bd57-49a44f805e60', 'volume_size': 1} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1580054140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9aafd7-af44-41a1-bd57-49a44f805e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e4b03d46ae43a1b946c0848a0e068c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:40Z,use_quota=True,user_id='8a1f3da38870466c91570c778c48b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Creating volume 2f9aafd7-af44-41a1-bd57-49a44f805e60 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:40 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:40 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 1073741824 Apr 02 19:57:40 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:40 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 1073741824" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:41 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 Apr 02 19:57:41 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (00774c8f-605a-4af0-ad08-00b2997b310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a1d75-7163-4c54-a5bd-54d9eaff1d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a1d75-7163-4c54-a5bd-54d9eaff1d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-312224162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da304d70-e6d1-4cee-ad26-f664cc465b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:41Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e4ee1-5b03-4d90-b2c8-9e3d00e07868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e4ee1-5b03-4d90-b2c8-9e3d00e07868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c2aa6e-4695-4f94-b615-c86cff0e8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c2aa6e-4695-4f94-b615-c86cff0e8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da304d70-e6d1-4cee-ad26-f664cc465b78', 'volume_name': 'volume-da304d70-e6d1-4cee-ad26-f664cc465b78', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434c0b1c-2a43-4ec5-8eaf-b2b090ef5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434c0b1c-2a43-4ec5-8eaf-b2b090ef5599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6de1580-3d87-4892-9ab6-79312da804a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Volume da304d70-e6d1-4cee-ad26-f664cc465b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da304d70-e6d1-4cee-ad26-f664cc465b78', 'volume_size': 1} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (2ba71026-7b51-4405-8b4a-ca20f71c7b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267b4e49-6e98-4d4d-a82e-53e1d937db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267b4e49-6e98-4d4d-a82e-53e1d937db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257036527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6506e776-fc88-4b93-8bd7-24c801b875a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630c27c2-de3a-4a11-b629-c24edfc2349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630c27c2-de3a-4a11-b629-c24edfc2349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af605d6-08b2-4345-8871-c67a683cefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af605d6-08b2-4345-8871-c67a683cefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6506e776-fc88-4b93-8bd7-24c801b875a7', 'volume_name': 'volume-6506e776-fc88-4b93-8bd7-24c801b875a7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51635e58-9f9a-4d03-aec0-bca5e85ab450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51635e58-9f9a-4d03-aec0-bca5e85ab450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bae05d-01d1-465a-8a43-23db22c4ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Volume 6506e776-fc88-4b93-8bd7-24c801b875a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6506e776-fc88-4b93-8bd7-24c801b875a7', 'volume_size': 1} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60" returned: 0 in 0.854s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.246s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-312224162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da304d70-e6d1-4cee-ad26-f664cc465b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:41Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Creating volume da304d70-e6d1-4cee-ad26-f664cc465b78 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:41 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:41 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 1073741824 Apr 02 19:57:41 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fea72a44-05a7-450c-b0a0-9264122a7d62 tempest-GroupsV320Test-314549205 None] Group tempest-GroupsV320Test-Group-368969988: creating Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44023ec-bec9-4ea5-b166-8b8c92483395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9aafd7-af44-41a1-bd57-49a44f805e60', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b867ac1-9d09-411a-9f7c-919e00063f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Volume volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 (2f9aafd7-af44-41a1-bd57-49a44f805e60): created successfully Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b867ac1-9d09-411a-9f7c-919e00063f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Flow 'volume_create_manager' (e6832757-5e6a-4bf6-92cf-1084a004d784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-5fe04d7d-8dba-426e-84ec-fb9a941f2b8d tempest-VolumesTransfersV355Test-659524190 None] Created volume successfully. Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fea72a44-05a7-450c-b0a0-9264122a7d62 tempest-GroupsV320Test-314549205 None] Group tempest-GroupsV320Test-Group-368969988: created successfully Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fea72a44-05a7-450c-b0a0-9264122a7d62 tempest-GroupsV320Test-314549205 None] Create group completed successfully. Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (12b4fa65-19b3-48be-8070-12e114baab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96cb478-d8b0-44ad-a2b2-80f28e89077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96cb478-d8b0-44ad-a2b2-80f28e89077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-487985447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7243a8f0-a66c-4d00-b3bd-d451a6fa67f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f531f58b-0c03-472d-b7bc-cf53735ba752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f531f58b-0c03-472d-b7bc-cf53735ba752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb96148-b3ce-498b-a583-4841f331eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb96148-b3ce-498b-a583-4841f331eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7243a8f0-a66c-4d00-b3bd-d451a6fa67f2', 'volume_name': 'volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea189fb1-7e12-435e-8aea-04172dc3254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea189fb1-7e12-435e-8aea-04172dc3254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f91068-e0bf-4dde-a685-a759a9359299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Volume 7243a8f0-a66c-4d00-b3bd-d451a6fa67f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2', 'volume_size': 1} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (c2f36823-f891-4a23-adc0-7e644e0cd301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91e0891-18fe-4219-8c60-18992f2c8075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91e0891-18fe-4219-8c60-18992f2c8075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-132371226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5490331b-e876-4001-9117-72b544b23d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd7f409-ca2a-4944-9109-ef4b6521b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd7f409-ca2a-4944-9109-ef4b6521b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d14df6d-3533-4313-a794-601fd19e9a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d14df6d-3533-4313-a794-601fd19e9a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5490331b-e876-4001-9117-72b544b23d91', 'volume_name': 'volume-5490331b-e876-4001-9117-72b544b23d91', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6798a6-628b-4475-a557-9f2254a3c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6798a6-628b-4475-a557-9f2254a3c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ca9872-76c1-468e-be1d-2267e130cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Volume 5490331b-e876-4001-9117-72b544b23d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5490331b-e876-4001-9117-72b544b23d91', 'volume_size': 1} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:42 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 1073741824" returned: 0 in 0.647s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:42 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 Apr 02 19:57:42 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (d3fea2d0-cae4-49c0-a9c5-d305a39ab466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafb199-95c5-48ee-98e3-d80bca884b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafb199-95c5-48ee-98e3-d80bca884b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013310909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef7a7f1-9648-4113-9969-076698a3b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:43Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a191ff-106b-4001-9ac0-4382ac686b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a191ff-106b-4001-9ac0-4382ac686b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba9006-bae0-453d-8ff5-d3b1938dea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba9006-bae0-453d-8ff5-d3b1938dea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef7a7f1-9648-4113-9969-076698a3b95f', 'volume_name': 'volume-7ef7a7f1-9648-4113-9969-076698a3b95f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65da08f-5dc8-4f0b-9998-ee551e95ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65da08f-5dc8-4f0b-9998-ee551e95ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8c39e6-9406-42fd-b4e4-5f446058ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Volume 7ef7a7f1-9648-4113-9969-076698a3b95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef7a7f1-9648-4113-9969-076698a3b95f', 'volume_size': 1} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "cinder-2f9aafd7-af44-41a1-bd57-49a44f805e60-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-2f9aafd7-af44-41a1-bd57-49a44f805e60-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "cinder-quobyte-2f9aafd7-af44-41a1-bd57-49a44f805e60" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-quobyte-2f9aafd7-af44-41a1-bd57-49a44f805e60" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d1ee7-6125-451d-9f0f-4b745bdc70d0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:43 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 Apr 02 19:57:43 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Created reservations ['6b58ee1f-44f7-4ac0-8688-643f70e8e12a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:43 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78" returned: 0 in 0.909s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257036527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6506e776-fc88-4b93-8bd7-24c801b875a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Creating volume 6506e776-fc88-4b93-8bd7-24c801b875a7 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:43 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:43 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:43 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:43 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 1073741824 Apr 02 19:57:43 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6de1580-3d87-4892-9ab6-79312da804a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da304d70-e6d1-4cee-ad26-f664cc465b78', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1904948-fead-4612-a582-6c19fc1dea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:43 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Volume volume-da304d70-e6d1-4cee-ad26-f664cc465b78 (da304d70-e6d1-4cee-ad26-f664cc465b78): created successfully Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1904948-fead-4612-a582-6c19fc1dea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (00774c8f-605a-4af0-ad08-00b2997b310a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-edf03abe-a7ed-4e93-b6f4-27ee56a95ee8 tempest-CreateVolumesFromImageTest-819410628 None] Created volume successfully. Apr 02 19:57:43 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60" returned: 0 in 0.824s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:43 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60 Apr 02 19:57:43 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:43 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.519s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:43 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6ac6f958-a265-4461-b15e-f86e26b9bdbe tempest-GroupsV320Test-314549205 None] Delete group completed successfully. Apr 02 19:57:44 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 1073741824" returned: 0 in 0.634s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:44 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 Apr 02 19:57:44 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:44 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2f9aafd7-af44-41a1-bd57-49a44f805e60" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-quobyte-2f9aafd7-af44-41a1-bd57-49a44f805e60" released by "delete_volume" :: held 1.344s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Created reservations ['e1cabfe3-a47a-4388-b131-249442854617', '341b4bfe-754c-4e70-80d6-d2ec64f03cd6', '4588fe15-2348-4a17-98d0-5e9997b4487d', '9f19d1b8-3c73-4264-aa65-d15e1ec7de77'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:44 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:44 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:44 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7" returned: 0 in 0.506s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-487985447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7243a8f0-a66c-4d00-b3bd-d451a6fa67f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Creating volume 7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:44 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bae05d-01d1-465a-8a43-23db22c4ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6506e776-fc88-4b93-8bd7-24c801b875a7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ab567-eca9-4916-a190-166018777b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:44 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 1073741824 Apr 02 19:57:44 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:44 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Volume volume-6506e776-fc88-4b93-8bd7-24c801b875a7 (6506e776-fc88-4b93-8bd7-24c801b875a7): created successfully Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ab567-eca9-4916-a190-166018777b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (2ba71026-7b51-4405-8b4a-ca20f71c7b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-bd52b5a6-fa9b-454e-8758-95945d7b1b86 tempest-CreateVolumesFromImageTest-819410628 None] Created volume successfully. Apr 02 19:57:44 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.623s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:44 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Deleted volume successfully. Apr 02 19:57:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9485b858-4dec-4e33-99a8-f2b0c10666ec tempest-VolumesTransfersV355Test-1932079569 None] Lock "cinder-2f9aafd7-af44-41a1-bd57-49a44f805e60-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:45 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 1073741824" returned: 0 in 0.794s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:45 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 Apr 02 19:57:45 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:46 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" returned: 0 in 0.812s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.810s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-132371226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5490331b-e876-4001-9117-72b544b23d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:42Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Creating volume 5490331b-e876-4001-9117-72b544b23d91 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:46 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f91068-e0bf-4dde-a685-a759a9359299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:46 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 1073741824 Apr 02 19:57:46 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a2138c-f19a-42dc-b3ee-3788fdd3f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Volume volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 (7243a8f0-a66c-4d00-b3bd-d451a6fa67f2): created successfully Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a2138c-f19a-42dc-b3ee-3788fdd3f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (12b4fa65-19b3-48be-8070-12e114baab0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2fa3f779-f9cd-4649-9956-686c575cd39a tempest-CreateVolumesFromImageTest-819410628 None] Created volume successfully. Apr 02 19:57:47 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 1073741824" returned: 0 in 0.905s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:47 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 Apr 02 19:57:47 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:47 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91" returned: 0 in 0.589s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.041s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2013310909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef7a7f1-9648-4113-9969-076698a3b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f249e6039269411c95581840f87be72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:43Z,use_quota=True,user_id='53260a1930fb487ca5be69e87d8e9ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Creating volume 7ef7a7f1-9648-4113-9969-076698a3b95f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:47 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ca9872-76c1-468e-be1d-2267e130cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5490331b-e876-4001-9117-72b544b23d91', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac5f3e0-8045-4509-8a77-6e2a5242891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:47 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Volume volume-5490331b-e876-4001-9117-72b544b23d91 (5490331b-e876-4001-9117-72b544b23d91): created successfully Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac5f3e0-8045-4509-8a77-6e2a5242891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (c2f36823-f891-4a23-adc0-7e644e0cd301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c05b7c96-66e2-4b98-b4aa-8dc14c1e8314 tempest-CreateVolumesFromImageTest-819410628 None] Created volume successfully. Apr 02 19:57:47 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f 1073741824 Apr 02 19:57:47 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:48 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f 1073741824" returned: 0 in 0.809s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:48 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f Apr 02 19:57:48 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Flow 'volume_create_manager' (bd7be7e6-7542-4a72-aa95-6e9fb89d63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a5c510-710f-42a1-ae3f-123667f55862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a5c510-710f-42a1-ae3f-123667f55862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2098094947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff72cbf-bf40-48d2-a1e6-9a29dc64239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80963b74c2e6469a8cfcdb94e67c9a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:49Z,use_quota=True,user_id='6899fcd28f544e46817c41f1a7da3492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e52d65-4f4d-4c83-ab54-9751d9978aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e52d65-4f4d-4c83-ab54-9751d9978aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe3dd74-8181-4d24-bf3a-75cc6638919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe3dd74-8181-4d24-bf3a-75cc6638919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff72cbf-bf40-48d2-a1e6-9a29dc64239f', 'volume_name': 'volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e037e9-82e0-4564-b590-0b8fc9dfb7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e037e9-82e0-4564-b590-0b8fc9dfb7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0ee6fc-01ca-46b8-bdbd-a72650c33b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f', 'volume_size': 1} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:49 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2098094947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff72cbf-bf40-48d2-a1e6-9a29dc64239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80963b74c2e6469a8cfcdb94e67c9a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:49Z,use_quota=True,user_id='6899fcd28f544e46817c41f1a7da3492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Creating volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:49 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8c39e6-9406-42fd-b4e4-5f446058ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef7a7f1-9648-4113-9969-076698a3b95f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f 1073741824 Apr 02 19:57:49 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c491beb5-1188-4827-b513-279943f458d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Volume volume-7ef7a7f1-9648-4113-9969-076698a3b95f (7ef7a7f1-9648-4113-9969-076698a3b95f): created successfully Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c491beb5-1188-4827-b513-279943f458d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Flow 'volume_create_manager' (d3fea2d0-cae4-49c0-a9c5-d305a39ab466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-09abccb8-286c-45a8-8e7b-2028142a728a tempest-CreateVolumesFromImageTest-819410628 None] Created volume successfully. Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-7ef7a7f1-9648-4113-9969-076698a3b95f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-7ef7a7f1-9648-4113-9969-076698a3b95f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-quobyte-7ef7a7f1-9648-4113-9969-076698a3b95f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-7ef7a7f1-9648-4113-9969-076698a3b95f" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b6b384-c1b2-412d-af01-080b7b4f07a7]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:49 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f Apr 02 19:57:49 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:49 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f 1073741824" returned: 0 in 0.683s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:50 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f Apr 02 19:57:50 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Flow 'volume_create_manager' (b1dbf9fe-9dc1-48a4-b3cd-15e50d8da92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d94539-fea6-4aad-b169-ec192cc83bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d94539-fea6-4aad-b169-ec192cc83bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1973853544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c051c82d25a545829cfe4ff57822eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:50Z,use_quota=True,user_id='a23503454b7042d29d13a25a35e45c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9974986-9bdb-470a-9f6d-c4362a91db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9974986-9bdb-470a-9f6d-c4362a91db06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf47a9a-053b-43c2-8306-1b2159aaf4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.image.glance [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Creating Keystone auth plugin from conf {{(pid=82597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf47a9a-053b-43c2-8306-1b2159aaf4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7', 'volume_name': 'volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256ae97-6387-4d0c-8972-1f3908791f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256ae97-6387-4d0c-8972-1f3908791f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b52126-8a14-4355-b6d4-c18ffb1f62e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:50 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Trying to clone cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 from image 9973ca61-39fa-459d-874e-a0e627b97de3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]). {{(pid=82597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f" returned: 0 in 0.814s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:50 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f Apr 02 19:57:50 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:50 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0ee6fc-01ca-46b8-bdbd-a72650c33b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7197c2-beee-4a02-b990-daf4dee831aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:50 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Volume volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f (0ff72cbf-bf40-48d2-a1e6-9a29dc64239f): created successfully Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7197c2-beee-4a02-b990-daf4dee831aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Flow 'volume_create_manager' (bd7be7e6-7542-4a72-aa95-6e9fb89d63f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 19:57:50 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Image download 20.69 MB at 20.69 MB/s Apr 02 19:57:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8fcda240-3a08-4aa3-96ab-5f63944e3a43 tempest-SnapshotsActionsTest-950980321 None] Created volume successfully. Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2a87e-e53e-4884-9479-96fdf2a4154d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:50 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD Apr 02 19:57:50 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:51 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7ef7a7f1-9648-4113-9969-076698a3b95f" returned: 0 in 0.681s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-7ef7a7f1-9648-4113-9969-076698a3b95f" released by "delete_volume" :: held 1.544s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Created reservations ['58fab870-2faa-432f-90ef-1fefd40627b4', '198499e2-b7c9-499d-a342-670371bb898e', '2bf12729-86e3-489b-b2ed-52f3a2a5fe0f', 'db31bf97-30fb-4f51-9418-32e633521259'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:51 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:51 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:51 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 is fetched for user a23503454b7042d29d13a25a35e45c63. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd449e00-2fe4-41e4-8068-d5ec7836faf9]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:51 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD Apr 02 19:57:51 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Creating offline snapshot e99740a3-79f2-471b-ba46-76b2b1b7fc8d of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d075b8f7-cd87-4c59-be71-d52a4fee341b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:51 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f Apr 02 19:57:51 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-5490331b-e876-4001-9117-72b544b23d91-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-5490331b-e876-4001-9117-72b544b23d91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-quobyte-5490331b-e876-4001-9117-72b544b23d91" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-5490331b-e876-4001-9117-72b544b23d91" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e77cd-84ad-43dc-a38d-cc2f91dae854]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:52 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 Apr 02 19:57:52 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:52 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 1.094s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:52 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Deleted volume successfully. Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2a8d1d64-fbd4-4602-ba84-8b9a5e4d8b2d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-7ef7a7f1-9648-4113-9969-076698a3b95f-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:52 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD" returned: 0 in 1.140s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Flow 'volume_create_manager' (b50e7b21-e0e1-46b8-be43-c4d2bd4649a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d37cd63-23c1-4d9e-b6e9-e0866da0e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d37cd63-23c1-4d9e-b6e9-e0866da0e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf75133-f78e-438d-bead-92dcf51fdeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3193fd499f143ed99e5dc5d29e9fdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:53Z,use_quota=True,user_id='f4281fd58ab34a9b98c45703614e403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab01f602-a828-4d7f-b091-6ef075c6b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab01f602-a828-4d7f-b091-6ef075c6b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acc4e2-27b5-453b-851c-8204afae02ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.image.glance [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Creating Keystone auth plugin from conf {{(pid=82597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 19:57:52 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91" returned: 0 in 0.727s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:52 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91 Apr 02 19:57:52 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:52 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acc4e2-27b5-453b-851c-8204afae02ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2bf75133-f78e-438d-bead-92dcf51fdeeb', 'volume_name': 'volume-2bf75133-f78e-438d-bead-92dcf51fdeeb', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b66fcf-1078-4197-b147-a7570d09fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b66fcf-1078-4197-b147-a7570d09fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da31e5ec-a463-419f-b630-6b4ebfb956b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:57:52 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume 2bf75133-f78e-438d-bead-92dcf51fdeeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2bf75133-f78e-438d-bead-92dcf51fdeeb', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Trying to clone 2bf75133-f78e-438d-bead-92dcf51fdeeb from image 9973ca61-39fa-459d-874e-a0e627b97de3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]). {{(pid=82597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" returned: 0 in 1.039s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:52 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d 1G Apr 02 19:57:52 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 19:57:53 devstack cinder-volume[82597]: INFO cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Image download 20.69 MB at 20.69 MB/s Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa264d-7c37-452d-87ff-2714ee970593]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:53 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5490331b-e876-4001-9117-72b544b23d91" returned: 0 in 0.534s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-5490331b-e876-4001-9117-72b544b23d91" released by "delete_volume" :: held 1.303s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:53 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD Apr 02 19:57:53 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Created reservations ['b48bcb0a-026f-4b11-bd05-a872e089093a', 'c448cac2-551e-421f-98d4-e5515b59f74f', '897cf7cf-2c6d-4001-ac92-d99aac07e910', 'ada1fb28-3ba9-4793-8625-c6519adab2fc'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:53 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:53 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:53 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d 1G" returned: 0 in 0.744s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:53 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:57:53 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:53 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD" returned: 0 in 0.609s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 is fetched for user f4281fd58ab34a9b98c45703614e403b. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a4ddf9-60e1-4b8c-88ca-449b4e046b5c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:53 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Deleted volume successfully. Apr 02 19:57:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-51ac191a-0e36-4e15-851d-da6cfe0f7b3a tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-5490331b-e876-4001-9117-72b544b23d91-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:53 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD Apr 02 19:57:53 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:54 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.473s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:54 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d is being set with open permissions: ugo+rw Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:54 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:57:54 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-quobyte-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" acquired by "delete_volume" :: waited 0.019s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5319c0f-8eb9-40cd-81d3-3948b241ff1d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:54 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD" returned: 0 in 0.566s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:54 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 Apr 02 19:57:54 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:54 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.489s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:54 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info Apr 02 19:57:54 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:54 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" returned: 0 in 0.562s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:54 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2 Apr 02 19:57:54 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:55 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:55 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info is being set with open permissions: ugo+rw Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:55 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info Apr 02 19:57:55 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:55 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" returned: 0 in 0.406s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2" released by "delete_volume" :: held 1.008s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Created reservations ['b6f95d88-333e-443d-9d42-f985de5ced9c', 'b40b099b-4b07-4aac-9b6b-78da314e99cc', '33bf4153-f614-4161-9b33-8b10c5db5c3e', '6f0f9e23-9318-4609-91bb-40c7df1c9725'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:55 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:55 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:55 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.info" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.734s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1973853544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c051c82d25a545829cfe4ff57822eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:50Z,use_quota=True,user_id='a23503454b7042d29d13a25a35e45c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Creating volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:55 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:55 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1073741824 Apr 02 19:57:55 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-449b07a1-b6c9-4bec-8d80-c851a99aa995 tempest-SnapshotsActionsTest-950980321 None] Create snapshot completed successfully Apr 02 19:57:55 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.465s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Deleted volume successfully. Apr 02 19:57:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9dac3679-046a-47a3-94f5-8cfcbbe92d7d tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-7243a8f0-a66c-4d00-b3bd-d451a6fa67f2-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:56 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1073741824" returned: 0 in 0.525s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:56 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:57:56 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-6506e776-fc88-4b93-8bd7-24c801b875a7-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-6506e776-fc88-4b93-8bd7-24c801b875a7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-quobyte-6506e776-fc88-4b93-8bd7-24c801b875a7" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-6506e776-fc88-4b93-8bd7-24c801b875a7" acquired by "delete_volume" :: waited 0.019s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca9fe3-6e93-475a-a372-beab801d365f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:56 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 0.565s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.221s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:57:52Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf75133-f78e-438d-bead-92dcf51fdeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3193fd499f143ed99e5dc5d29e9fdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:57:53Z,use_quota=True,user_id='f4281fd58ab34a9b98c45703614e403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Creating volume 2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:57:56 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:56 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 Apr 02 19:57:56 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Attempting download of 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 19:57:56 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1073741824 Apr 02 19:57:56 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ad5d7-cc7e-42f5-a26a-dd65186a6334]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:56 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p Apr 02 19:57:56 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7" returned: 0 in 0.692s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7 Apr 02 19:57:57 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p Apr 02 19:57:57 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1073741824" returned: 0 in 0.663s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:57:57 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p" returned: 1 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vauq4n_p' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c0f15-12ad-4096-9c60-4386d975a6bf]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6506e776-fc88-4b93-8bd7-24c801b875a7" returned: 0 in 0.485s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-6506e776-fc88-4b93-8bd7-24c801b875a7" released by "delete_volume" :: held 1.216s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Created reservations ['a4d3c24a-1e12-4a57-ab77-99b74e0205ec', '94a8fd98-fc9e-43aa-9fdb-1571bab5f13a', 'e0cea420-ecbf-4874-a0b2-ecbf96d2ebc0', 'a2aa9807-d075-4e9e-83d4-5056cd49cb07'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:57:57 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD Apr 02 19:57:57 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.150s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:57:57 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Attempting download of 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume 2bf75133-f78e-438d-bead-92dcf51fdeeb. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Creating offline snapshot 41e83194-2c09-45c8-b01b-a0699caa01f9 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d548d0-47a0-441f-b237-34b22a65d7a5]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061d2cb-d36b-4df8-b563-45c49aebfc3e]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:57 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:57:57 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:58 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig Apr 02 19:57:58 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:58 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] 9973ca61-39fa-459d-874e-a0e627b97de3 was qcow2, converting to raw {{(pid=82597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:58 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:57:58 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:58 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig" returned: 0 in 0.637s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:58 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.705s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:58 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.786s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:57:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Deleted volume successfully. Apr 02 19:57:58 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 1G Apr 02 19:57:58 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7f77a773-c550-489c-9304-a5d739e45c97 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-6506e776-fc88-4b93-8bd7-24c801b875a7-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:57:58 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig Apr 02 19:57:58 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-da304d70-e6d1-4cee-ad26-f664cc465b78-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-da304d70-e6d1-4cee-ad26-f664cc465b78-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "cinder-quobyte-da304d70-e6d1-4cee-ad26-f664cc465b78" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-da304d70-e6d1-4cee-ad26-f664cc465b78" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83116e-aebf-4448-8d54-2e5ee92bacca]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:58 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 Apr 02 19:57:58 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:59 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig" returned: 1 in 0.754s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_3jmcu6ig' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c516bf-0cc0-44a4-996c-e4c538a97a6d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:59 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD Apr 02 19:57:59 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:59 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 1G" returned: 0 in 0.831s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:59 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:59 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 Apr 02 19:57:59 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:59 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78 Apr 02 19:57:59 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:57:59 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 1.417s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_iu7w11aodevstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:57:59 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Converted 112.00 MB image at 78.96 MB/s Apr 02 19:57:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:57:59 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1G Apr 02 19:57:59 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:00 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] 9973ca61-39fa-459d-874e-a0e627b97de3 was qcow2, converting to raw {{(pid=82597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:00 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:00 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:00 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da304d70-e6d1-4cee-ad26-f664cc465b78" returned: 0 in 0.606s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-quobyte-da304d70-e6d1-4cee-ad26-f664cc465b78" released by "delete_volume" :: held 1.215s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Created reservations ['ca4c19c8-3367-465d-ae50-41a840c01b8c', 'f338fcaf-09d3-4773-bdd8-f796453299e0', '15280107-7184-4392-a457-3582c27ac37b', 'd095161b-2d29-47e0-a801-426a5ea14bad'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:00 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9" returned: 0 in 0.768s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:00 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 is being set with open permissions: ugo+rw Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:00 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 Apr 02 19:58:00 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:00 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:00 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:00 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 1G" returned: 0 in 0.710s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152d008-f39b-459f-930e-26de1dac7c41]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:00 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:00 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:01 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.776s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Deleted volume successfully. Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-2c814474-9f07-4a59-bc46-ec6a2a37b844 tempest-CreateVolumesFromImageTest-819410628 None] Lock "cinder-da304d70-e6d1-4cee-ad26-f664cc465b78-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:01 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 1.021s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_tqv88ga3devstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:58:01 devstack cinder-volume[82597]: INFO cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Converted 112.00 MB image at 109.62 MB/s Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:01 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9" returned: 0 in 0.885s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1G Apr 02 19:58:01 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2fd214dc-4870-44bb-9335-09012edbc6d5 tempest-SnapshotsActionsTest-950980321 None] Create snapshot completed successfully Apr 02 19:58:01 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 0.705s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:01 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:01 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:01 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb 1G" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c81f2-8fa7-4d4e-8527-d73b11839f8e]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:01 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:01 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:01 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 1 in 0.540s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Downloaded image 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 successfully. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 for user a23503454b7042d29d13a25a35e45c63 is deleted. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Marking volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 as bootable. {{(pid=82597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Copying metadata from image 9973ca61-39fa-459d-874e-a0e627b97de3 to cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7. {{(pid=82597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Creating volume glance metadata for volume cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 backed by image 9973ca61-39fa-459d-874e-a0e627b97de3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b52126-8a14-4355-b6d4-c18ffb1f62e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74849a25-e73a-4f88-a8d0-237f51fa19ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:01 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Volume volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 (cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7): created successfully Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74849a25-e73a-4f88-a8d0-237f51fa19ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:01 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Flow 'volume_create_manager' (b1dbf9fe-9dc1-48a4-b3cd-15e50d8da92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e860cfe2-5ec2-469a-ae25-c5dfa75e1515 tempest-VolumesExtendTest-597967921 None] Created volume successfully. Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-41e83194-2c09-45c8-b01b-a0699caa01f9-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-41e83194-2c09-45c8-b01b-a0699caa01f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2824642d-b805-4f90-8ece-36602a56dbb3]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_snapshot" :: waited 0.050s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-41e83194-2c09-45c8-b01b-a0699caa01f9" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-41e83194-2c09-45c8-b01b-a0699caa01f9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Deleting offline snapshot 41e83194-2c09-45c8-b01b-a0699caa01f9 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] snapshot_file for this snap is: volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a955bf-9b8f-4da7-985b-55e2477410ec]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:02 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:02 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:02 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 Apr 02 19:58:02 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:02 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 0.875s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:02 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:02 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:02 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9" returned: 0 in 0.685s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c58636-b17c-4567-8514-f946f4f0c715]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:03 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:03 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:03 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 0.915s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:03 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 1 in 0.761s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Downloaded image 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume 2bf75133-f78e-438d-bead-92dcf51fdeeb successfully. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 for user f4281fd58ab34a9b98c45703614e403b is deleted. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Marking volume 2bf75133-f78e-438d-bead-92dcf51fdeeb as bootable. {{(pid=82597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Copying metadata from image 9973ca61-39fa-459d-874e-a0e627b97de3 to 2bf75133-f78e-438d-bead-92dcf51fdeeb. {{(pid=82597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Creating volume glance metadata for volume 2bf75133-f78e-438d-bead-92dcf51fdeeb backed by image 9973ca61-39fa-459d-874e-a0e627b97de3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 19:58:03 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:03 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da31e5ec-a463-419f-b630-6b4ebfb956b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf75133-f78e-438d-bead-92dcf51fdeeb', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982a7a97-fe9f-4f84-9a16-60e68e56c847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Volume volume-2bf75133-f78e-438d-bead-92dcf51fdeeb (2bf75133-f78e-438d-bead-92dcf51fdeeb): created successfully Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982a7a97-fe9f-4f84-9a16-60e68e56c847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Flow 'volume_create_manager' (b50e7b21-e0e1-46b8-be43-c4d2bd4649a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-2661a454-989c-41df-8420-e36e15991dbb tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Created volume successfully. Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (0611b378-f881-4ed3-87d3-0ff16c67bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d506fd-1722-45b1-9425-90b43ff9ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d506fd-1722-45b1-9425-90b43ff9ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118717885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251feb54-30da-4269-a23a-be94fcf2162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:03Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1434ee-db0f-464b-913b-abbadda84d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1434ee-db0f-464b-913b-abbadda84d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6a6ec-a28b-408b-8d34-7ce0531612aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6a6ec-a28b-408b-8d34-7ce0531612aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251feb54-30da-4269-a23a-be94fcf2162f', 'volume_name': 'volume-251feb54-30da-4269-a23a-be94fcf2162f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35594dd5-b33d-4eb7-bc75-35403d37f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35594dd5-b33d-4eb7-bc75-35403d37f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d0aef-995c-48d4-a4fe-6dfd9bcd8e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:03 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 251feb54-30da-4269-a23a-be94fcf2162f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251feb54-30da-4269-a23a-be94fcf2162f', 'volume_size': 1} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:03 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.693s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:03 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 Apr 02 19:58:03 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:03 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 1 in 0.652s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 2G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 2G" returned: 0 in 0.036s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.677s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118717885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251feb54-30da-4269-a23a-be94fcf2162f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:03Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 251feb54-30da-4269-a23a-be94fcf2162f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:03 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:03 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f 1073741824 Apr 02 19:58:03 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-51c73884-a0eb-4ba0-a133-3a26515edc62 tempest-VolumesExtendTest-597967921 None] Extend volume completed successfully. Apr 02 19:58:04 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:04 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9 Apr 02 19:58:04 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:04 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f 1073741824" returned: 0 in 0.505s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:04 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f Apr 02 19:58:04 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "cinder-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-quobyte-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3a634-ee0f-4725-a7bc-b2b9a1ac2bab]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:04 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.41e83194-2c09-45c8-b01b-a0699caa01f9" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-41e83194-2c09-45c8-b01b-a0699caa01f9" released by "_delete_snapshot" :: held 2.390s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_snapshot" :: held 2.420s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:04 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:04 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Created reservations ['0910bac8-2272-4414-9b4d-5ff9e5d0e582', '8411013a-e559-4728-bce6-cad66d52693c', '0c853fce-4887-4182-83e0-a2415b1ed999', '371f150f-10ed-4401-b4e3-531637dab8ec'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:04 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Delete snapshot completed successfully. Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-def9c5b8-c250-4281-8043-d511310ba5c1 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-41e83194-2c09-45c8-b01b-a0699caa01f9-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:04 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f" returned: 0 in 0.625s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157d0aef-995c-48d4-a4fe-6dfd9bcd8e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251feb54-30da-4269-a23a-be94fcf2162f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118ea22e-9965-4dbd-b11e-ba6f52213bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:05 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-251feb54-30da-4269-a23a-be94fcf2162f (251feb54-30da-4269-a23a-be94fcf2162f): created successfully Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118ea22e-9965-4dbd-b11e-ba6f52213bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (0611b378-f881-4ed3-87d3-0ff16c67bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:05 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8e2dc63b-5db0-4ebf-b230-1204462dfe85 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff2bc59-0322-4ab0-86d2-fe97560dd133]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:05 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 0.597s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:05 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:05 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:05 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:05 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:05 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:05 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 1 in 0.520s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:05 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7 Apr 02 19:58:05 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:05 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:05 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (9d247178-7840-4ef2-8c0e-7813ea131d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3b09e6-68d9-4119-b93f-eeb2778a3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3b09e6-68d9-4119-b93f-eeb2778a3775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306388671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5887b959-1234-44ca-ad57-e0be9b73df52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6984b38-a9a0-4d4f-b7a9-0b0240761e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6984b38-a9a0-4d4f-b7a9-0b0240761e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562b601a-82dc-4d5c-8fd9-3a44ee214ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562b601a-82dc-4d5c-8fd9-3a44ee214ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5887b959-1234-44ca-ad57-e0be9b73df52', 'volume_name': 'volume-5887b959-1234-44ca-ad57-e0be9b73df52', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:05 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496708c1-b1fe-43fc-8d89-1c16d956e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496708c1-b1fe-43fc-8d89-1c16d956e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4496e99f-a8e6-4b12-99ce-cbbdba57f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 5887b959-1234-44ca-ad57-e0be9b73df52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5887b959-1234-44ca-ad57-e0be9b73df52', 'volume_size': 1} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (b48d9a69-89db-47bc-8d1f-d849c88a720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f846a4-6556-400e-963a-585e7baf1b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f846a4-6556-400e-963a-585e7baf1b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205709969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb3e92e-52f0-4885-940e-d7fd9b12e8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3683ab-a437-4ba5-91f6-b9b31c600c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3683ab-a437-4ba5-91f6-b9b31c600c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e369d-3545-4993-9f8e-3178fbc8ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e369d-3545-4993-9f8e-3178fbc8ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb3e92e-52f0-4885-940e-d7fd9b12e8ab', 'volume_name': 'volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9a199-e728-4fbb-9f28-d4cbe74403a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa9a199-e728-4fbb-9f28-d4cbe74403a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16f3356-6dc9-4dd2-9a8a-9272139de54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 1fb3e92e-52f0-4885-940e-d7fd9b12e8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab', 'volume_size': 1} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7" released by "delete_volume" :: held 1.656s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Created reservations ['b29ee2bb-4e13-462a-8c3d-5d8bac7ad758', '7fdd3a94-13ce-47ce-a100-89ca1a0bcafd', '391dcbfa-31e5-4e92-94e9-7ddd84bab97f', 'ea3e0056-3aa7-4f15-b482-9607beca1fee'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (7065d9db-b8bd-406c-839e-45ff180f4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f14f6e-127c-46b1-afc4-f9822902fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f14f6e-127c-46b1-afc4-f9822902fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805078748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601c641-99fa-4626-bf42-f1e00ea9f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1030305d-7720-4a67-bad1-0e75ccf014f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1030305d-7720-4a67-bad1-0e75ccf014f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:06 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:06 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4edf4-a892-477f-9fca-b08752853546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4edf4-a892-477f-9fca-b08752853546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2601c641-99fa-4626-bf42-f1e00ea9f67d', 'volume_name': 'volume-2601c641-99fa-4626-bf42-f1e00ea9f67d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ef9f1b-6e62-4e32-83ea-b11fdae0c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ef9f1b-6e62-4e32-83ea-b11fdae0c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d7677c-ed2b-44ff-a16a-9db3d7f07f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 2601c641-99fa-4626-bf42-f1e00ea9f67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2601c641-99fa-4626-bf42-f1e00ea9f67d', 'volume_size': 1} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 1 in 0.686s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.228s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.855s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Creating offline snapshot 1416288a-3333-4681-a2c9-c914799e2daf of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f52283-b9c7-4637-ade9-9e0839bbfb57]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b', 'name': 'volume-2bf75133-f78e-438d-bead-92dcf51fdeeb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17e11844-eca7-444b-8942-dc9683146dc5', 'enforce_multipath': True} {{(pid=82597) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 19:58:06 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:06 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-32e49cd0-82af-4eab-acd0-1407f592ffbb req-54b6a885-9ae4-4d49-9001-9881783295d9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] attachment_update completed successfully. Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (684015b8-349f-42f5-b120-70bc16734c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5751bf-5b55-4da0-9bb8-5b61b5f5d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5751bf-5b55-4da0-9bb8-5b61b5f5d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647073485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792a5b56-8184-4254-8da5-50864bb1aba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84f640d-3328-4d15-9e88-cf971d05030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84f640d-3328-4d15-9e88-cf971d05030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed42f0b-5b9d-4a6b-bed7-de9ae8f31a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed42f0b-5b9d-4a6b-bed7-de9ae8f31a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792a5b56-8184-4254-8da5-50864bb1aba3', 'volume_name': 'volume-792a5b56-8184-4254-8da5-50864bb1aba3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b4b14-f107-46e3-a908-3743c4679885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b4b14-f107-46e3-a908-3743c4679885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624d7009-9178-4b0d-9200-406e554b0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 792a5b56-8184-4254-8da5-50864bb1aba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792a5b56-8184-4254-8da5-50864bb1aba3', 'volume_size': 1} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:06 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:06 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:06 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (ea5668ca-dd0a-4a6d-8c3b-39126cecf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e439624a-a51e-4079-82f1-b5063586530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.539s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Deleted volume successfully. Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e439624a-a51e-4079-82f1-b5063586530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488377369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef95b7b-c23f-4700-9ebf-85dc195e07ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cb47bc-632a-4a1c-93b0-20d45bed54ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cb47bc-632a-4a1c-93b0-20d45bed54ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff84914-e7fa-4497-84a7-8048ed6924f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff84914-e7fa-4497-84a7-8048ed6924f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef95b7b-c23f-4700-9ebf-85dc195e07ae', 'volume_name': 'volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451a6d76-a546-4dbe-ab12-4e0bb9aedf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451a6d76-a546-4dbe-ab12-4e0bb9aedf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd038b6-8533-45cc-a4df-10d156adfa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume 3ef95b7b-c23f-4700-9ebf-85dc195e07ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae', 'volume_size': 1} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-dd60d4a6-dadd-4b19-9864-785b08e3c9bd tempest-VolumesExtendTest-597967921 None] Lock "cinder-cdea28a1-2ab4-46a4-a9ba-a7d13a2600b7-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:07 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.640s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:07 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf 1G Apr 02 19:58:07 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Flow 'volume_create_manager' (6c9322ba-ecbf-4aa8-8bd5-b7b22c67f152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70247234-b170-4436-96a0-815ca7bd2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70247234-b170-4436-96a0-815ca7bd2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1947659195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b1f309-63fb-4244-9b24-e3135815ed2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c051c82d25a545829cfe4ff57822eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a23503454b7042d29d13a25a35e45c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57560a50-cf30-4798-9661-21dd5dbf6778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57560a50-cf30-4798-9661-21dd5dbf6778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb1b247-4582-4bfd-bb99-c9896997b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb1b247-4582-4bfd-bb99-c9896997b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b1f309-63fb-4244-9b24-e3135815ed2e', 'volume_name': 'volume-d4b1f309-63fb-4244-9b24-e3135815ed2e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba793b18-fafe-436b-bb5c-4a2c9d092abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba793b18-fafe-436b-bb5c-4a2c9d092abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeef4f45-3044-4df1-a3c0-84a47e2e8dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Volume d4b1f309-63fb-4244-9b24-e3135815ed2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b1f309-63fb-4244-9b24-e3135815ed2e', 'volume_size': 1} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:07 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.472s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:07 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf 1G" returned: 0 in 0.485s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:07 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf Apr 02 19:58:07 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:07 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf" returned: 0 in 0.416s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:07 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf is being set with open permissions: ugo+rw Apr 02 19:58:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:08 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf Apr 02 19:58:08 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:08 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf" returned: 0 in 0.407s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306388671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5887b959-1234-44ca-ad57-e0be9b73df52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 5887b959-1234-44ca-ad57-e0be9b73df52 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:08 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:08 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 1073741824 Apr 02 19:58:08 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:08 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3a01932a-75ad-4367-8b0c-ef4a43b01bd0 tempest-SnapshotsActionsTest-950980321 None] Create snapshot completed successfully Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-1416288a-3333-4681-a2c9-c914799e2daf-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-1416288a-3333-4681-a2c9-c914799e2daf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-1416288a-3333-4681-a2c9-c914799e2daf" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-1416288a-3333-4681-a2c9-c914799e2daf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Deleting offline snapshot 1416288a-3333-4681-a2c9-c914799e2daf of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] snapshot_file for this snap is: volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ed101-112b-4de9-9d9a-2d694c7a45bb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:08 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 1073741824" returned: 0 in 0.537s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:09 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 Apr 02 19:58:09 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:09 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf Apr 02 19:58:09 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:09 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52" returned: 0 in 0.408s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.183s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205709969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb3e92e-52f0-4885-940e-d7fd9b12e8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 1fb3e92e-52f0-4885-940e-d7fd9b12e8ab {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:09 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4496e99f-a8e6-4b12-99ce-cbbdba57f29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5887b959-1234-44ca-ad57-e0be9b73df52', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3546a30e-0aee-4c15-9f87-3fc1d8b7c9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:09 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab 1073741824 Apr 02 19:58:09 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-5887b959-1234-44ca-ad57-e0be9b73df52 (5887b959-1234-44ca-ad57-e0be9b73df52): created successfully Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3546a30e-0aee-4c15-9f87-3fc1d8b7c9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (9d247178-7840-4ef2-8c0e-7813ea131d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:09 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0397ce21-ca31-4e51-b1ce-aa0f1da8d9c3 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28fe474-ddd7-4605-9286-1b48e0eebdd4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:09 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:09 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:09 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab 1073741824" returned: 0 in 0.533s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:09 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:09 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab Apr 02 19:58:09 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:09 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf Apr 02 19:58:09 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:10 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" returned: 0 in 0.411s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.982s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805078748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601c641-99fa-4626-bf42-f1e00ea9f67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:06Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 2601c641-99fa-4626-bf42-f1e00ea9f67d {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:10 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16f3356-6dc9-4dd2-9a8a-9272139de54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31be7832-c373-40de-8631-f05297861226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:10 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d 1073741824 Apr 02 19:58:10 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab (1fb3e92e-52f0-4885-940e-d7fd9b12e8ab): created successfully Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31be7832-c373-40de-8631-f05297861226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (b48d9a69-89db-47bc-8d1f-d849c88a720d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:10 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9f697d60-ba9a-4188-8d3a-fb2f85afa08f tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:10 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf" returned: 0 in 0.476s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:10 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf Apr 02 19:58:10 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:10 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:10 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.1416288a-3333-4681-a2c9-c914799e2daf" returned: 0 in 0.442s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d 1073741824" returned: 0 in 0.582s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-1416288a-3333-4681-a2c9-c914799e2daf" released by "_delete_snapshot" :: held 2.073s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_snapshot" :: held 2.093s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:11 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d Apr 02 19:58:11 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Created reservations ['59061d07-61dc-4c24-a82e-6cf2939df03c', '8a663b9b-ce99-4f3c-b367-6563e1c1a3bb', '0a9ad0f4-94a5-4eb1-af8b-40f936ec8db0', '0b7016f3-2fa1-4fbe-8222-48cd0e01f4e3'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Delete snapshot completed successfully. Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d8984adb-9695-462b-be98-80e559d4c78f tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-1416288a-3333-4681-a2c9-c914799e2daf-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:11 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647073485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792a5b56-8184-4254-8da5-50864bb1aba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 792a5b56-8184-4254-8da5-50864bb1aba3 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:11 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d7677c-ed2b-44ff-a16a-9db3d7f07f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2601c641-99fa-4626-bf42-f1e00ea9f67d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb94338-bdd6-47d2-b44c-28eaed273fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-2601c641-99fa-4626-bf42-f1e00ea9f67d (2601c641-99fa-4626-bf42-f1e00ea9f67d): created successfully Apr 02 19:58:11 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 1073741824 Apr 02 19:58:11 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb94338-bdd6-47d2-b44c-28eaed273fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (7065d9db-b8bd-406c-839e-45ff180f4abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7c29c615-922e-4165-a42a-e7b026befef4 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 1073741824" returned: 0 in 0.892s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:12 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:12 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 Apr 02 19:58:12 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:13 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3" returned: 0 in 0.558s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.113s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488377369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef95b7b-c23f-4700-9ebf-85dc195e07ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21911c8a4594fa1a770e1d4a0fa60d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a4193463727c41e8ac3d17fe0b2c9389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Creating volume 3ef95b7b-c23f-4700-9ebf-85dc195e07ae {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:13 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624d7009-9178-4b0d-9200-406e554b0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792a5b56-8184-4254-8da5-50864bb1aba3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:13 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae 1073741824 Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb213d97-1d0f-4c68-b516-9857e20183b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:13 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:13 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-792a5b56-8184-4254-8da5-50864bb1aba3 (792a5b56-8184-4254-8da5-50864bb1aba3): created successfully Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb213d97-1d0f-4c68-b516-9857e20183b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (684015b8-349f-42f5-b120-70bc16734c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-aa447235-60cd-49be-9b3e-2e46cf8474af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:13 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae 1073741824" returned: 0 in 0.633s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:13 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae Apr 02 19:58:13 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:14 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.993s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1947659195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b1f309-63fb-4244-9b24-e3135815ed2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c051c82d25a545829cfe4ff57822eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:07Z,use_quota=True,user_id='a23503454b7042d29d13a25a35e45c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Creating volume d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd038b6-8533-45cc-a4df-10d156adfa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83af4632-e916-41df-8b25-7427fc71e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:14 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e 1073741824 Apr 02 19:58:14 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Volume volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae (3ef95b7b-c23f-4700-9ebf-85dc195e07ae): created successfully Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83af4632-e916-41df-8b25-7427fc71e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Flow 'volume_create_manager' (ea5668ca-dd0a-4a6d-8c3b-39126cecf75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c9504b2c-3e9a-4f41-a292-e18baf0bb9af tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created volume successfully. Apr 02 19:58:14 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e 1073741824" returned: 0 in 0.584s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=250,cinder:SELECT=223,cinder:INSERT=69,cinder:DELETE=15 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=215,cinder:UPDATE=241,cinder:DELETE=22,cinder:INSERT=82 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-3ef95b7b-c23f-4700-9ebf-85dc195e07ae-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-3ef95b7b-c23f-4700-9ebf-85dc195e07ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:14 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:14 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5275e94-d793-4c81-baa3-b19eee337f54]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:14 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae Apr 02 19:58:14 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:15 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.404s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.634s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeef4f45-3044-4df1-a3c0-84a47e2e8dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b1f309-63fb-4244-9b24-e3135815ed2e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c488b4e7-14a8-4508-84d2-6ef27c12e106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Creating offline snapshot c1455c03-b508-47e6-ac72-b244e9392981 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:15 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Volume volume-d4b1f309-63fb-4244-9b24-e3135815ed2e (d4b1f309-63fb-4244-9b24-e3135815ed2e): created successfully Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c488b4e7-14a8-4508-84d2-6ef27c12e106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Flow 'volume_create_manager' (6c9322ba-ecbf-4aa8-8bd5-b7b22c67f152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2cc5d3-3058-4dca-8549-e9b68b3eb79e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b5604402-f34f-4080-8e11-ef7efeaaa362 tempest-VolumesExtendTest-597967921 None] Created volume successfully. Apr 02 19:58:15 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:15 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:15 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:15 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae Apr 02 19:58:15 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:15 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-3ef95b7b-c23f-4700-9ebf-85dc195e07ae" released by "delete_volume" :: held 0.950s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['117419d2-c0e7-4469-848f-b0201e15a221', '7babc64b-3970-4eb6-a326-33bf98fd9302', 'e401910b-3167-414c-93b1-e9c4a83d0e1d', '510d3833-2ea8-4ce7-be6e-1b5dfe17e6dd'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:15 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:15 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:15 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.709s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:15 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 1G Apr 02 19:58:15 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:16 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.413s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-39277944-12cb-4867-8d64-487ef96ba8a9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-3ef95b7b-c23f-4700-9ebf-85dc195e07ae-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:16 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 1G" returned: 0 in 0.523s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:16 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 Apr 02 19:58:16 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-792a5b56-8184-4254-8da5-50864bb1aba3-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-792a5b56-8184-4254-8da5-50864bb1aba3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:16 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-792a5b56-8184-4254-8da5-50864bb1aba3" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981" returned: 0 in 0.512s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:17 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 is being set with open permissions: ugo+rw Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-792a5b56-8184-4254-8da5-50864bb1aba3" acquired by "delete_volume" :: waited 0.021s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:17 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 Apr 02 19:58:17 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec33e3-b6ec-443e-b73d-119c4019328a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:17 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 Apr 02 19:58:17 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:17 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.469s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Creating offline snapshot fb81299d-faf4-4fb5-827d-ac142979ee12 of volume d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef14ab2-7db8-44bc-affa-82bc2b4fa45b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cfe40fc7-1cb9-4bba-a43c-49c9c053b850 tempest-SnapshotsActionsTest-950980321 None] Create snapshot completed successfully Apr 02 19:58:17 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:17 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3 Apr 02 19:58:17 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:17 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:17 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-c1455c03-b508-47e6-ac72-b244e9392981-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-c1455c03-b508-47e6-ac72-b244e9392981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-c1455c03-b508-47e6-ac72-b244e9392981" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-c1455c03-b508-47e6-ac72-b244e9392981" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Deleting offline snapshot c1455c03-b508-47e6-ac72-b244e9392981 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] snapshot_file for this snap is: volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d45408-b063-4d8e-9722-3a8088e46772]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:18 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-792a5b56-8184-4254-8da5-50864bb1aba3" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-792a5b56-8184-4254-8da5-50864bb1aba3" released by "delete_volume" :: held 1.004s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:18 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 Apr 02 19:58:18 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['63bb6c7c-50d4-4d6b-b913-1dca32bb68f0', '9dd6eb7a-998d-4557-be1c-cfb7c77a3843', '52851244-17e2-48af-b333-07cd8390687a', '5501efce-2fc1-45a2-9fa3-7807d5a84117'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:18 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.689s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:18 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 1G Apr 02 19:58:18 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:18 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:18 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:18 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981" returned: 0 in 0.731s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eaa9b6-c04b-4369-a6cb-11111a118444]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:18 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:18 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-71a88c0d-8f5b-44bf-b60c-8757daf0121d tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-792a5b56-8184-4254-8da5-50864bb1aba3-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:18 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 1G" returned: 0 in 0.529s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1f309-63fb-4244-9b24-e3135815ed2e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:18 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:18 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:18 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1f309-63fb-4244-9b24-e3135815ed2e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 Apr 02 19:58:18 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.490s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b1f309-63fb-4244-9b24-e3135815ed2e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12" returned: 0 in 0.435s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:19 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 is being set with open permissions: ugo+rw Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 Apr 02 19:58:19 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 Apr 02 19:58:19 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-2601c641-99fa-4626-bf42-f1e00ea9f67d-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-2601c641-99fa-4626-bf42-f1e00ea9f67d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-2601c641-99fa-4626-bf42-f1e00ea9f67d" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-2601c641-99fa-4626-bf42-f1e00ea9f67d" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc58928-4815-4725-86d5-97c2ea4d3ef5]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d Apr 02 19:58:19 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info Apr 02 19:58:19 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981 Apr 02 19:58:19 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:19 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d" returned: 0 in 0.589s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:19 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d Apr 02 19:58:19 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:20 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info" returned: 0 in 0.417s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:20 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info is being set with open permissions: ugo+rw Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:20 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info Apr 02 19:58:20 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:20 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.c1455c03-b508-47e6-ac72-b244e9392981" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-c1455c03-b508-47e6-ac72-b244e9392981" released by "_delete_snapshot" :: held 2.271s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_snapshot" :: held 2.291s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Created reservations ['81f8e108-bcb6-4c1d-a94a-35d6190290e1', 'b626087f-355a-4bc6-a49f-78d27e4e0b03', 'c4a3ae99-6eca-4e43-a6e6-bc910316cf4f', 'e7ba36be-d98c-4bc0-955c-eb944c260606'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Delete snapshot completed successfully. Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-96199b28-9787-4f07-a843-40bb163a1513 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-c1455c03-b508-47e6-ac72-b244e9392981-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:20 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2601c641-99fa-4626-bf42-f1e00ea9f67d" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-2601c641-99fa-4626-bf42-f1e00ea9f67d" released by "delete_volume" :: held 1.074s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['cdde96c3-06af-4a87-af0a-6e68a54097d2', '2ee976f2-7748-43b3-bacc-c61c8249a42d', 'db975ef9-d4f0-4789-b23b-da89814ec6c1', 'a4e98efc-7d9a-445c-b18e-4a611f777da6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:20 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:20 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:20 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.info" returned: 0 in 0.432s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6ba0989b-6d19-4a2f-8fb6-f9f302a6a6be tempest-VolumesExtendTest-597967921 None] Create snapshot completed successfully Apr 02 19:58:20 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cb4bc4ce-233f-4436-a1f5-7221017eb0b1 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-2601c641-99fa-4626-bf42-f1e00ea9f67d-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Creating offline snapshot f0f7c676-7167-427a-bb11-aa1c8d87e344 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb9206-60ed-48ba-8c49-012059ab825d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:21 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:21 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" acquired by "delete_volume" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[83109b48-2d32-4b91-8256-bb3e589e5fd8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:21 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab Apr 02 19:58:21 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:21 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:21 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 1G Apr 02 19:58:21 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:21 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" returned: 0 in 0.521s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:22 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab Apr 02 19:58:22 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:22 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 1G" returned: 0 in 0.562s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:22 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 Apr 02 19:58:22 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:22 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab" released by "delete_volume" :: held 0.983s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['b7e41a1a-8f4b-4835-ad43-481389b6d4c9', 'd642c8c7-9d5e-4251-a5da-dfcbe92ac008', 'e577fe6f-66b1-4b48-a6ed-202e3ae0b134', '788c08a5-38c0-4ed5-8071-776ef3c52c01'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:22 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:22 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-5887b959-1234-44ca-ad57-e0be9b73df52-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-5887b959-1234-44ca-ad57-e0be9b73df52-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-5887b959-1234-44ca-ad57-e0be9b73df52" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-5887b959-1234-44ca-ad57-e0be9b73df52" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d7e080-937d-44fe-a70a-c8aceead018c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:22 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 Apr 02 19:58:22 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:22 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344" returned: 0 in 0.510s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:22 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 is being set with open permissions: ugo+rw Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:22 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 Apr 02 19:58:22 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:22 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ab69d488-2f42-4fa7-86b8-27be2009c201 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-1fb3e92e-52f0-4885-940e-d7fd9b12e8ab-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:23 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52" returned: 0 in 0.461s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:23 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52 Apr 02 19:58:23 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:23 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344" returned: 0 in 0.419s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.916s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[db836c2d-4bdf-4964-9739-45525a043550]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-831770c2-3cde-4261-8fec-154e8bd662f4 tempest-SnapshotsActionsTest-950980321 None] Create snapshot completed successfully Apr 02 19:58:23 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:23 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:23 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5887b959-1234-44ca-ad57-e0be9b73df52" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-5887b959-1234-44ca-ad57-e0be9b73df52" released by "delete_volume" :: held 0.920s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['da6b0b05-b5a6-4fbf-8698-991470c27d6a', '9360b924-c2b9-44e1-95bf-433344f6e18c', '47222241-8434-4bb7-b985-79649deff634', '530d7577-2ab9-48e3-8b62-0c7845767988'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:23 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:23 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-251feb54-30da-4269-a23a-be94fcf2162f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-251feb54-30da-4269-a23a-be94fcf2162f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:23 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 2G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "cinder-quobyte-251feb54-30da-4269-a23a-be94fcf2162f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-251feb54-30da-4269-a23a-be94fcf2162f" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2aeb8f-0490-486f-ba93-ae1bb64ef22e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 2G" returned: 0 in 0.066s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.601s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ebcd6a60-e806-4263-941a-571aa41db209 tempest-VolumesExtendTest-597967921 None] Extend volume completed successfully. Apr 02 19:58:23 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f Apr 02 19:58:23 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:24 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f95d756d-afd1-4daf-acad-ab0a4f8d44b9 tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-5887b959-1234-44ca-ad57-e0be9b73df52-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:24 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f" returned: 0 in 0.549s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:24 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f Apr 02 19:58:24 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-f0f7c676-7167-427a-bb11-aa1c8d87e344-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-f0f7c676-7167-427a-bb11-aa1c8d87e344-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Acquiring lock "cinder-quobyte-f0f7c676-7167-427a-bb11-aa1c8d87e344" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-f0f7c676-7167-427a-bb11-aa1c8d87e344" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Deleting offline snapshot f0f7c676-7167-427a-bb11-aa1c8d87e344 of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] snapshot_file for this snap is: volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6777572e-de4f-4a37-a903-554966b96edf]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-fb81299d-faf4-4fb5-827d-ac142979ee12-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-fb81299d-faf4-4fb5-827d-ac142979ee12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-quobyte-fb81299d-faf4-4fb5-827d-ac142979ee12" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:24 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 Apr 02 19:58:24 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-fb81299d-faf4-4fb5-827d-ac142979ee12" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Deleting offline snapshot fb81299d-faf4-4fb5-827d-ac142979ee12 of volume d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] snapshot_file for this snap is: volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03b8ec-b54b-4092-bb7d-0c5ea178cb01]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:24 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 Apr 02 19:58:24 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:25 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-251feb54-30da-4269-a23a-be94fcf2162f" returned: 0 in 0.809s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-quobyte-251feb54-30da-4269-a23a-be94fcf2162f" released by "delete_volume" :: held 1.384s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Created reservations ['3565d7db-e93b-49ab-a033-12de8c85b479', 'e5fe40ae-f30e-4c6a-aa3a-fbd889af462e', '00d14173-3598-4b8d-ab7c-1a82546f8d51', 'dc6c5fb0-f738-4ba8-9d46-63e0b5f3cdb7'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:25 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:25 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:25 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344" returned: 0 in 0.738s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cc6bf5-3739-492a-a2fb-f43a18e38b3e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:25 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:25 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:25 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12" returned: 0 in 0.612s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b1f309-63fb-4244-9b24-e3135815ed2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f41b60-8480-4292-b2cb-3102ef78af52]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:25 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:25 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:25 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.432s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Deleted volume successfully. Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9987a137-0d56-4bdf-bed9-17768c23447b tempest-CreateVolumesFromSourceVolumeTest-2127589395 None] Lock "cinder-251feb54-30da-4269-a23a-be94fcf2162f-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:25 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.612s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:25 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 Apr 02 19:58:25 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:26 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.734s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:26 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 Apr 02 19:58:26 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:26 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344" returned: 0 in 0.741s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:26 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344 Apr 02 19:58:26 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:26 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12" returned: 0 in 0.791s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:27 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12 Apr 02 19:58:27 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:27 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.f0f7c676-7167-427a-bb11-aa1c8d87e344" returned: 0 in 0.505s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-f0f7c676-7167-427a-bb11-aa1c8d87e344" released by "_delete_snapshot" :: held 2.674s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_snapshot" :: held 2.696s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Created reservations ['827dd8f1-ff8a-4758-bb9c-7824fde0afc3', 'acde936f-4d5e-4a70-8e49-0f2d63a1183c', '1e361072-d2aa-4b2e-9c68-bdcfddcac79e', '424b0057-1a2f-416c-b354-7e2de49e048d'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Delete snapshot completed successfully. Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6e0ed7c1-394d-49f6-a979-52e2d856c108 tempest-SnapshotsActionsTest-256991900 None] Lock "cinder-f0f7c676-7167-427a-bb11-aa1c8d87e344-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e.fb81299d-faf4-4fb5-827d-ac142979ee12" returned: 0 in 0.652s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-fb81299d-faf4-4fb5-827d-ac142979ee12" released by "_delete_snapshot" :: held 2.868s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" released by "delete_snapshot" :: held 2.889s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Created reservations ['d19d226d-5ae3-4343-b87d-1cae3fa34230', '6e777c43-e467-4b6e-ba72-8f235db3ffae', 'dfb1cd8d-5043-4a8a-9fdf-7d5d298481dc', '4ad0ebef-462f-4f18-915f-52d7e4c8fa91'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Delete snapshot completed successfully. Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2d7aa16-8659-4ef4-8337-ce9fd2613c9e tempest-VolumesExtendTest-597967921 None] Lock "cinder-fb81299d-faf4-4fb5-827d-ac142979ee12-delete_snapshot" released by "delete_snapshot" :: held 3.052s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-d4b1f309-63fb-4244-9b24-e3135815ed2e-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "cinder-d4b1f309-63fb-4244-9b24-e3135815ed2e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Acquiring lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e70e9-d63a-4e99-aa86-e42b89dc8366]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Flow 'volume_create_manager' (f47ec5ec-af23-4548-bf7b-fe526786210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:28 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:28 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08696a37-0872-4d7c-bb1c-a0d080d6ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08696a37-0872-4d7c-bb1c-a0d080d6ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c278ceec-75f8-4d63-a376-c6f08799109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9517af7fd14f649829bb999bac0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:28Z,use_quota=True,user_id='64f070514d46409ab368301422ae7295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c5172f-e5b4-4582-958e-c19ec294d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c5172f-e5b4-4582-958e-c19ec294d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7dca8-ac62-4e43-8479-0acbfd40c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df7dca8-ac62-4e43-8479-0acbfd40c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c278ceec-75f8-4d63-a376-c6f08799109b', 'volume_name': 'volume-c278ceec-75f8-4d63-a376-c6f08799109b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da6081b-c9ac-4594-9f9c-214c8a977f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da6081b-c9ac-4594-9f9c-214c8a977f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3273918e-c8ec-4400-a3de-b8117904cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Volume c278ceec-75f8-4d63-a376-c6f08799109b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c278ceec-75f8-4d63-a376-c6f08799109b', 'volume_size': 1} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c278ceec-75f8-4d63-a376-c6f08799109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9517af7fd14f649829bb999bac0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:28Z,use_quota=True,user_id='64f070514d46409ab368301422ae7295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Creating volume c278ceec-75f8-4d63-a376-c6f08799109b {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:28 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "cinder-e99740a3-79f2-471b-ba46-76b2b1b7fc8d-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:28 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b 1073741824 Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-e99740a3-79f2-471b-ba46-76b2b1b7fc8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:28 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "cinder-quobyte-e99740a3-79f2-471b-ba46-76b2b1b7fc8d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-e99740a3-79f2-471b-ba46-76b2b1b7fc8d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Deleting offline snapshot e99740a3-79f2-471b-ba46-76b2b1b7fc8d of volume 0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] snapshot_file for this snap is: volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[789e2408-d30b-44eb-bcfb-32276c9bc6a5]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:28 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:28 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:28 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:28 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e Apr 02 19:58:28 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:28 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b 1073741824" returned: 0 in 0.533s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:28 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.564s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:28 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b Apr 02 19:58:28 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[670584d1-816c-4df3-bbd5-2a699ab69e7d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:29 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f Apr 02 19:58:29 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:29 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d4b1f309-63fb-4244-9b24-e3135815ed2e" returned: 0 in 0.668s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "cinder-quobyte-d4b1f309-63fb-4244-9b24-e3135815ed2e" released by "delete_volume" :: held 1.278s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Created reservations ['d861b445-92ab-423c-90a6-60d0ba3cd67c', 'e15223ee-3cf1-4408-95c1-51d66246c6bd', 'aabc559f-deb4-4447-9400-2bcad3dee967', '82a9f701-39c4-4f4e-a259-9a3abada0fe4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:29 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:29 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:29 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b" returned: 0 in 0.623s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3273918e-c8ec-4400-a3de-b8117904cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c278ceec-75f8-4d63-a376-c6f08799109b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565cbe52-cac8-47f4-8721-69db4b791360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:29 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Volume volume-c278ceec-75f8-4d63-a376-c6f08799109b (c278ceec-75f8-4d63-a376-c6f08799109b): created successfully Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565cbe52-cac8-47f4-8721-69db4b791360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Flow 'volume_create_manager' (f47ec5ec-af23-4548-bf7b-fe526786210f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-03594d8e-e094-451d-850f-c4757b56bea4 tempest-CinderUnicodeTest-57739665 None] Created volume successfully. Apr 02 19:58:29 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" returned: 0 in 0.687s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:29 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:29 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:29 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:29 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Deleted volume successfully. Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1a366bca-2ce0-43cd-97b4-adc0d6459cc3 tempest-VolumesExtendTest-597967921 None] Lock "cinder-d4b1f309-63fb-4244-9b24-e3135815ed2e-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:30 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:30 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d Apr 02 19:58:30 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:30 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f.e99740a3-79f2-471b-ba46-76b2b1b7fc8d" returned: 0 in 0.608s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-e99740a3-79f2-471b-ba46-76b2b1b7fc8d" released by "_delete_snapshot" :: held 2.458s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_snapshot" :: held 2.475s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:30 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Created reservations ['f5bc0a04-cf87-4bf5-a5c1-039ae91c8614', 'bb2814af-762b-4da7-9108-78dbb3f293e2', 'f9d905b6-33b0-4e4a-a0a5-fdff13446d33', '3c5457eb-f6f3-484d-8ae9-cd0a94416af0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Delete snapshot completed successfully. Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1acca18-ca7a-4259-90be-701e90b30808 tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-e99740a3-79f2-471b-ba46-76b2b1b7fc8d-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Flow 'volume_create_manager' (b61f9409-04d8-41d0-8dce-9b01fad38c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5f89f-e774-4217-89ec-a3103e410c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5f89f-e774-4217-89ec-a3103e410c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-744095994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724398f7-1063-48ec-8532-b284538bc578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9517af7fd14f649829bb999bac0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:31Z,use_quota=True,user_id='64f070514d46409ab368301422ae7295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd5787-1776-498e-80ee-68f4746f2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd5787-1776-498e-80ee-68f4746f2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fce8c2-f1be-40a6-bd75-3860a1a22b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fce8c2-f1be-40a6-bd75-3860a1a22b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724398f7-1063-48ec-8532-b284538bc578', 'volume_name': 'volume-724398f7-1063-48ec-8532-b284538bc578', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e331fe-ad2d-4ceb-825a-368db5f5b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e331fe-ad2d-4ceb-825a-368db5f5b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12500a4-58e2-4a35-ab29-6cc00a1cac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:31 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Volume 724398f7-1063-48ec-8532-b284538bc578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724398f7-1063-48ec-8532-b284538bc578', 'volume_size': 1} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-744095994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724398f7-1063-48ec-8532-b284538bc578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a9517af7fd14f649829bb999bac0712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:31Z,use_quota=True,user_id='64f070514d46409ab368301422ae7295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Creating volume 724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:31 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:31 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 1073741824 Apr 02 19:58:31 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "cinder-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0977139-7c2a-4d54-b9b0-85580c974f47]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:31 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f Apr 02 19:58:31 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:31 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 1073741824" returned: 0 in 0.756s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:32 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 Apr 02 19:58:32 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:32 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" returned: 0 in 0.833s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:32 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f Apr 02 19:58:32 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:32 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578" returned: 0 in 0.707s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12500a4-58e2-4a35-ab29-6cc00a1cac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724398f7-1063-48ec-8532-b284538bc578', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a40c6d-61da-4fc1-8146-33177e039b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:32 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Volume volume-724398f7-1063-48ec-8532-b284538bc578 (724398f7-1063-48ec-8532-b284538bc578): created successfully Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a40c6d-61da-4fc1-8146-33177e039b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Flow 'volume_create_manager' (b61f9409-04d8-41d0-8dce-9b01fad38c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-48bc7b1f-7933-4f94-ac8c-88af3435c689 tempest-CinderUnicodeTest-57739665 None] Created volume successfully. Apr 02 19:58:33 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" returned: 0 in 0.639s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-quobyte-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f" released by "delete_volume" :: held 1.512s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (dadd0afb-60aa-4422-9651-d67c513279d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed34dca5-9dff-4e71-b379-5f28b8b47db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed34dca5-9dff-4e71-b379-5f28b8b47db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1958967381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673260e3-af2a-49a8-aee9-eb571ccd2150,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:33Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794a98d9-0547-4947-9843-4c958ab0f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794a98d9-0547-4947-9843-4c958ab0f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bc2fbd-03aa-4e3c-b0da-9ff9b8469f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bc2fbd-03aa-4e3c-b0da-9ff9b8469f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673260e3-af2a-49a8-aee9-eb571ccd2150', 'volume_name': 'volume-673260e3-af2a-49a8-aee9-eb571ccd2150', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c61cb03-6594-48d8-97f8-aa9ed8446628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c61cb03-6594-48d8-97f8-aa9ed8446628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f167bf69-9e32-433f-95e0-1ee604bb41f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:33 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Volume 673260e3-af2a-49a8-aee9-eb571ccd2150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673260e3-af2a-49a8-aee9-eb571ccd2150', 'volume_size': 1} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1958967381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673260e3-af2a-49a8-aee9-eb571ccd2150,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:33Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Creating volume 673260e3-af2a-49a8-aee9-eb571ccd2150 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:33 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Created reservations ['7b48d805-87d6-45d8-a050-84e4ef55ebaf', 'ad79f563-ee10-4896-9683-a7c3e83b8fba', 'de1afcd8-5dc8-459d-8b3d-ab07776b7316', 'fa8ec1fd-8d92-41b5-b8c7-6a7fa6df7fef'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:33 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 1073741824 Apr 02 19:58:33 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:33 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:33 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:33 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Deleted volume successfully. Apr 02 19:58:33 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 1073741824" returned: 0 in 0.679s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-260b4bee-9056-4535-8bc6-810555eb59bf tempest-SnapshotsActionsTest-950980321 None] Lock "cinder-0ff72cbf-bf40-48d2-a1e6-9a29dc64239f-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:34 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 Apr 02 19:58:34 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:34 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.054s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f167bf69-9e32-433f-95e0-1ee604bb41f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673260e3-af2a-49a8-aee9-eb571ccd2150', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d06bf4-9760-4840-8468-6dd1c6ed7e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Volume volume-673260e3-af2a-49a8-aee9-eb571ccd2150 (673260e3-af2a-49a8-aee9-eb571ccd2150): created successfully Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d06bf4-9760-4840-8468-6dd1c6ed7e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (dadd0afb-60aa-4422-9651-d67c513279d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Creating offline snapshot 2566dfeb-5662-4029-9df5-5785d0dca0b8 of volume 724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3ce10729-fc16-463a-b80c-b4fb89e8979e tempest-VolumesListTestJSON-283431954 None] Created volume successfully. Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b133d0c-4971-484f-98a7-fe8cda3ad783]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:34 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 Apr 02 19:58:34 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-3fcfdc5e-559e-4332-b0bc-fab6d04997f8 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Terminate volume connection completed successfully. Apr 02 19:58:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-3fcfdc5e-559e-4332-b0bc-fab6d04997f8 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Deleting attachment 17e11844-eca7-444b-8942-dc9683146dc5. {{(pid=82597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 19:58:35 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578" returned: 0 in 0.543s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:35 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 1G Apr 02 19:58:35 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "cinder-2bf75133-f78e-438d-bead-92dcf51fdeeb-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-2bf75133-f78e-438d-bead-92dcf51fdeeb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "cinder-quobyte-2bf75133-f78e-438d-bead-92dcf51fdeeb" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-quobyte-2bf75133-f78e-438d-bead-92dcf51fdeeb" acquired by "delete_volume" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2a94e-88cb-4728-a906-628eab9b2f7b]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (c813d029-8b2e-4900-b151-1e94c793f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9074e1-81ce-47bb-8a53-a65c67c33af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:35 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:35 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9074e1-81ce-47bb-8a53-a65c67c33af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922975790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d208f326-d43d-41da-89ab-289017462e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:36Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6045cb-1c87-47eb-b249-72c387e4340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6045cb-1c87-47eb-b249-72c387e4340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a24e95-5b29-4f2c-b887-31629b96d1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:35 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a24e95-5b29-4f2c-b887-31629b96d1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd208f326-d43d-41da-89ab-289017462e4f', 'volume_name': 'volume-d208f326-d43d-41da-89ab-289017462e4f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e077c4-0510-436f-a049-a829b64f9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e077c4-0510-436f-a049-a829b64f9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd2101c-0d5a-49ef-af92-5b99413b3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:35 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Volume d208f326-d43d-41da-89ab-289017462e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d208f326-d43d-41da-89ab-289017462e4f', 'volume_size': 1} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 1G" returned: 0 in 0.715s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724398f7-1063-48ec-8532-b284538bc578 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:35 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724398f7-1063-48ec-8532-b284538bc578 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 Apr 02 19:58:35 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:36 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:36 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724398f7-1063-48ec-8532-b284538bc578 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8" returned: 0 in 0.527s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:36 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 is being set with open permissions: ugo+rw Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:36 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:36 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:36 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 Apr 02 19:58:36 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:36 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:36 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 1 in 0.547s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:36 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb Apr 02 19:58:36 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:36 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info Apr 02 19:58:36 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:37 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2bf75133-f78e-438d-bead-92dcf51fdeeb" returned: 0 in 0.472s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-quobyte-2bf75133-f78e-438d-bead-92dcf51fdeeb" released by "delete_volume" :: held 1.699s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.quota [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Created reservations ['53ab498f-9b90-4115-9f50-53a8cfdc4fc2', '88b5470d-97ca-4555-8535-c152a6b8e2f8', '25e11059-2b38-4a53-9b99-24e5ab5c0780', 'b4ec8e7f-25b4-4603-9c0e-84e10dc399ad'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:37 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info" returned: 0 in 0.489s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:37 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info is being set with open permissions: ugo+rw Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:37 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info Apr 02 19:58:37 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:37 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:37 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Flow 'volume_create_manager' (9955eddc-ae0f-4e35-ad08-c4937e8e8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55585d3-3375-45ac-a368-d8bc4fd2c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55585d3-3375-45ac-a368-d8bc4fd2c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2005444614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8397de-56bd-480e-831b-6fabdc424a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565ed95063d944dca0b9b200827adc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:37Z,use_quota=True,user_id='cd2cf41bad2c46308b8e3543fc964136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f17ca0-fb2b-46e0-b70d-69c7dedaabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f17ca0-fb2b-46e0-b70d-69c7dedaabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c544c6fc-7f4a-4b81-aa8e-632ee717efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c544c6fc-7f4a-4b81-aa8e-632ee717efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8397de-56bd-480e-831b-6fabdc424a9e', 'volume_name': 'volume-ed8397de-56bd-480e-831b-6fabdc424a9e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7e5819-69ff-4995-8983-666b611f6e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7e5819-69ff-4995-8983-666b611f6e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5da0e1-6d8c-4f81-8d8d-40b8eeede464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Volume ed8397de-56bd-480e-831b-6fabdc424a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8397de-56bd-480e-831b-6fabdc424a9e', 'volume_size': 1} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:37 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.info" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.268s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922975790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d208f326-d43d-41da-89ab-289017462e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:36Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Creating volume d208f326-d43d-41da-89ab-289017462e4f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:37 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:37 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f 1073741824 Apr 02 19:58:37 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d3569dd7-7480-4abf-9a58-d64b24871150 tempest-CinderUnicodeTest-57739665 None] Create snapshot completed successfully Apr 02 19:58:37 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.manager [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:37 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Deleted volume successfully. Apr 02 19:58:37 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-81cc3402-e70a-4ed3-aa67-d9cc06eb894a req-e69c30c3-2bdc-4118-bf3a-22102b2dbf8f tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-2bf75133-f78e-438d-bead-92dcf51fdeeb-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:38 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f 1073741824" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:38 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f Apr 02 19:58:38 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-2566dfeb-5662-4029-9df5-5785d0dca0b8-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-2566dfeb-5662-4029-9df5-5785d0dca0b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-quobyte-2566dfeb-5662-4029-9df5-5785d0dca0b8" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-2566dfeb-5662-4029-9df5-5785d0dca0b8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Deleting offline snapshot 2566dfeb-5662-4029-9df5-5785d0dca0b8 of volume 724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] snapshot_file for this snap is: volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3520fc4d-ae1b-403d-93d1-aa7ddc97a015]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:38 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 Apr 02 19:58:38 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:38 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f" returned: 0 in 0.513s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2005444614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8397de-56bd-480e-831b-6fabdc424a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565ed95063d944dca0b9b200827adc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:37Z,use_quota=True,user_id='cd2cf41bad2c46308b8e3543fc964136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Creating volume ed8397de-56bd-480e-831b-6fabdc424a9e {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:38 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd2101c-0d5a-49ef-af92-5b99413b3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d208f326-d43d-41da-89ab-289017462e4f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7451cd7d-a463-4147-926a-e487299d5f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:38 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e 1073741824 Apr 02 19:58:38 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:38 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Volume volume-d208f326-d43d-41da-89ab-289017462e4f (d208f326-d43d-41da-89ab-289017462e4f): created successfully Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7451cd7d-a463-4147-926a-e487299d5f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (c813d029-8b2e-4900-b151-1e94c793f823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7491d1f3-4f11-4f6d-871d-999166c31b10 tempest-VolumesListTestJSON-283431954 None] Created volume successfully. Apr 02 19:58:39 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-724398f7-1063-48ec-8532-b284538bc578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2dfd16-6416-4bb9-be92-e20df0a26444]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:39 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 Apr 02 19:58:39 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:39 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e 1073741824" returned: 0 in 0.534s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:39 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e Apr 02 19:58:39 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:39 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:39 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 Apr 02 19:58:39 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:39 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e" returned: 0 in 0.442s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5da0e1-6d8c-4f81-8d8d-40b8eeede464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8397de-56bd-480e-831b-6fabdc424a9e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fe6de8-e480-4be3-8ac6-b62dbe2faad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:39 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Volume volume-ed8397de-56bd-480e-831b-6fabdc424a9e (ed8397de-56bd-480e-831b-6fabdc424a9e): created successfully Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fe6de8-e480-4be3-8ac6-b62dbe2faad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Flow 'volume_create_manager' (9955eddc-ae0f-4e35-ad08-c4937e8e8527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:39 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-12882aea-0ea4-49d7-a19d-50f817b8169e tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Created volume successfully. Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (52845794-c024-4a69-818f-3da9354ca470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f87953-a3ba-4554-ac71-0b56851781e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f87953-a3ba-4554-ac71-0b56851781e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574571773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fa55f0-105a-4e74-bc0e-1d05ccc26457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:40Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db866e9-7daa-42f2-b47e-ff0c713d50f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db866e9-7daa-42f2-b47e-ff0c713d50f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ed602c-5dfd-4699-be51-c9ca2c3b4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ed602c-5dfd-4699-be51-c9ca2c3b4b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fa55f0-105a-4e74-bc0e-1d05ccc26457', 'volume_name': 'volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10aa11-9be8-47ca-8b3d-97ceb7040bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10aa11-9be8-47ca-8b3d-97ceb7040bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c420067-db18-46ad-948b-4c17ee6cf32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:40 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Volume 02fa55f0-105a-4e74-bc0e-1d05ccc26457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457', 'volume_size': 1} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-574571773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fa55f0-105a-4e74-bc0e-1d05ccc26457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be82b9fe8ca44e3d88f7172682315bd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:40Z,use_quota=True,user_id='a2decafda5764c8693b0792b1123db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Creating volume 02fa55f0-105a-4e74-bc0e-1d05ccc26457 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:40 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:40 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8" returned: 0 in 0.638s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:40 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 1073741824 Apr 02 19:58:40 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:40 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8 Apr 02 19:58:40 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:40 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578.2566dfeb-5662-4029-9df5-5785d0dca0b8" returned: 0 in 0.421s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-2566dfeb-5662-4029-9df5-5785d0dca0b8" released by "_delete_snapshot" :: held 2.172s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" released by "delete_snapshot" :: held 2.186s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Created reservations ['623d99d1-7876-40a5-b43c-3c408c582b93', 'e538a861-073f-4f58-af3f-cad730fab00a', '7ef65eaf-586c-48c1-87c4-7a8c50b1c2f3', '93c12f2c-ddc9-4602-97b7-c9adb873398a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:40 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Delete snapshot completed successfully. Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-851a2387-2ee8-41ba-941b-c8f6c810afe3 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-2566dfeb-5662-4029-9df5-5785d0dca0b8-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:40 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 1073741824" returned: 0 in 0.572s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:40 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 Apr 02 19:58:40 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Acquiring lock "cinder-ed8397de-56bd-480e-831b-6fabdc424a9e-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "cinder-ed8397de-56bd-480e-831b-6fabdc424a9e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Acquiring lock "cinder-quobyte-ed8397de-56bd-480e-831b-6fabdc424a9e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "cinder-quobyte-ed8397de-56bd-480e-831b-6fabdc424a9e" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d3e53a-b5db-4093-89f1-952ee3fe0269]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:41 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457" returned: 0 in 0.522s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c420067-db18-46ad-948b-4c17ee6cf32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d207c-162b-45c8-9616-f68b7c0c6e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:41 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e Apr 02 19:58:41 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Volume volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 (02fa55f0-105a-4e74-bc0e-1d05ccc26457): created successfully Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49d207c-162b-45c8-9616-f68b7c0c6e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Flow 'volume_create_manager' (52845794-c024-4a69-818f-3da9354ca470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-899e327e-fd66-4efc-9772-6b3814db9875 tempest-VolumesListTestJSON-283431954 None] Created volume successfully. Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-724398f7-1063-48ec-8532-b284538bc578-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-724398f7-1063-48ec-8532-b284538bc578-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" acquired by "delete_volume" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[78018be3-b331-4a27-93b6-17e7ba8b3e31]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:41 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e" returned: 0 in 0.515s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:41 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e Apr 02 19:58:41 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 Apr 02 19:58:41 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:41 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:42 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:42 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578" returned: 0 in 0.557s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ed8397de-56bd-480e-831b-6fabdc424a9e" returned: 0 in 0.485s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "cinder-quobyte-ed8397de-56bd-480e-831b-6fabdc424a9e" released by "delete_volume" :: held 1.062s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:42 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578 Apr 02 19:58:42 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Created reservations ['3cb4ca68-3664-4f3f-b3e3-73a4811ecdfc', 'bbec0d5f-a5d2-470b-be66-2ef131e4615f', '91039279-7fca-4e78-97d2-50f6d1e0f91e', 'a1a6ccc6-0686-4a8c-a311-63aeefb269ca'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:42 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:42 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:42 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-724398f7-1063-48ec-8532-b284538bc578" returned: 0 in 0.585s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-724398f7-1063-48ec-8532-b284538bc578" released by "delete_volume" :: held 1.177s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:43 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.459s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Deleted volume successfully. Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Created reservations ['c0923262-960f-40f2-97db-503e14368b63', '7a151954-ae16-429f-8045-988aab8aa642', '95ecca68-61fe-4168-bd73-01adde8b14d7', '519c3aa4-490a-4482-9965-a6a5aa71997b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4e395737-7fcc-4596-be38-345531641302 tempest-VolumeQuotasNegativeTestJSON-1575664583 None] Lock "cinder-ed8397de-56bd-480e-831b-6fabdc424a9e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:43 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:43 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:43 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.416s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Deleted volume successfully. Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db130355-b3e2-401c-a07d-febc5e0d88d5 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-724398f7-1063-48ec-8532-b284538bc578-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-c278ceec-75f8-4d63-a376-c6f08799109b-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-c278ceec-75f8-4d63-a376-c6f08799109b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "cinder-quobyte-c278ceec-75f8-4d63-a376-c6f08799109b" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-c278ceec-75f8-4d63-a376-c6f08799109b" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[68887c07-db7e-41cb-bca0-8030f9ee8162]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:44 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b Apr 02 19:58:44 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-02fa55f0-105a-4e74-bc0e-1d05ccc26457-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-02fa55f0-105a-4e74-bc0e-1d05ccc26457-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-quobyte-02fa55f0-105a-4e74-bc0e-1d05ccc26457" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-02fa55f0-105a-4e74-bc0e-1d05ccc26457" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9edfbf5-bdfc-4593-b467-7e91ade17bd3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:44 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 Apr 02 19:58:44 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:44 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b" returned: 0 in 0.573s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:44 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b Apr 02 19:58:44 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:45 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457" returned: 0 in 0.650s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:45 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c278ceec-75f8-4d63-a376-c6f08799109b" returned: 0 in 0.559s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-quobyte-c278ceec-75f8-4d63-a376-c6f08799109b" released by "delete_volume" :: held 1.178s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:45 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457 Apr 02 19:58:45 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Created reservations ['0d6a6ede-2d27-4d0c-a308-8c753ec53639', 'ba77838b-9799-4942-b65c-e1d273dd4b53', '999e9fac-f9b6-450f-8d85-6cf864aac487', '0f0c9fa6-0637-443f-860f-cf385ab142e4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:45 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:45 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:45 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-02fa55f0-105a-4e74-bc0e-1d05ccc26457" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-02fa55f0-105a-4e74-bc0e-1d05ccc26457" released by "delete_volume" :: held 1.171s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Created reservations ['8033ee70-7f6c-4d51-be97-ab4a6d7da53d', '86077d15-cb21-4e2a-9532-32f7a797cb6a', '8da60e7d-a90e-48b4-9edd-c3b29f1f73de', '6456fef3-1668-4f65-a9be-2bbc78ef548c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:45 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:45 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:45 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.503s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Deleted volume successfully. Apr 02 19:58:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-8c3c95da-a33b-4bca-b612-0312f0b21003 tempest-CinderUnicodeTest-57739665 None] Lock "cinder-c278ceec-75f8-4d63-a376-c6f08799109b-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:46 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.611s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Deleted volume successfully. Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-04ebf0e8-aac5-403d-a820-35541bb45b01 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-02fa55f0-105a-4e74-bc0e-1d05ccc26457-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-d208f326-d43d-41da-89ab-289017462e4f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-d208f326-d43d-41da-89ab-289017462e4f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-quobyte-d208f326-d43d-41da-89ab-289017462e4f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-d208f326-d43d-41da-89ab-289017462e4f" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadc7bc-e55a-47c4-b075-c37e7174f113]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:46 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f Apr 02 19:58:46 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:47 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f" returned: 0 in 0.600s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:47 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f Apr 02 19:58:47 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:47 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-d208f326-d43d-41da-89ab-289017462e4f" returned: 0 in 0.503s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-d208f326-d43d-41da-89ab-289017462e4f" released by "delete_volume" :: held 1.148s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Created reservations ['9be983e8-84b2-4969-ad07-cad6cd3c9c54', 'c6136710-56c4-4c1b-9cff-415e45185a4b', '90bbd470-84e0-49cd-a868-431bfb1e299b', 'bc7332b1-8acc-421c-a39e-326d33e19447'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:47 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:47 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:48 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.482s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Deleted volume successfully. Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7cf089d7-3103-4707-8877-ca0fcdfbe1e3 tempest-VolumesListTestJSON-283431954 None] Lock "cinder-d208f326-d43d-41da-89ab-289017462e4f-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-673260e3-af2a-49a8-aee9-eb571ccd2150-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "cinder-673260e3-af2a-49a8-aee9-eb571ccd2150-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Acquiring lock "cinder-quobyte-673260e3-af2a-49a8-aee9-eb571ccd2150" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-673260e3-af2a-49a8-aee9-eb571ccd2150" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f65b51-f751-4f3a-97a9-19a2952ba0c4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-3907a6a7-fbcb-4e56-bb44-62ae6424e0b9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Terminate volume connection completed successfully. Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-3907a6a7-fbcb-4e56-bb44-62ae6424e0b9 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Deleting attachment edef5385-adc9-4b2c-8498-76b590f9607b. {{(pid=82597) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 19:58:49 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 Apr 02 19:58:49 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:49 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:49 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150 Apr 02 19:58:49 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "cinder-35a3c178-4236-4706-92e7-e98f5a72d516-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-35a3c178-4236-4706-92e7-e98f5a72d516-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "cinder-quobyte-35a3c178-4236-4706-92e7-e98f5a72d516" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-quobyte-35a3c178-4236-4706-92e7-e98f5a72d516" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b925d23-b5c5-4fa7-99a0-88f967d9f8fb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:49 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 Apr 02 19:58:49 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:50 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-673260e3-af2a-49a8-aee9-eb571ccd2150" returned: 0 in 0.547s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "cinder-quobyte-673260e3-af2a-49a8-aee9-eb571ccd2150" released by "delete_volume" :: held 1.132s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Created reservations ['ee089bb6-7883-4c02-b75b-2a564257af4d', '7b7ff037-838f-4051-b117-fa88b89d7025', '6ede75f5-4e1d-4a3b-b22b-ee9991274762', 'eb1cbe5b-e547-489e-b463-983ae8e25662'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:50 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:50 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516 Apr 02 19:58:50 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:50 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:50 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:50 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-35a3c178-4236-4706-92e7-e98f5a72d516" returned: 0 in 0.436s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-quobyte-35a3c178-4236-4706-92e7-e98f5a72d516" released by "delete_volume" :: held 1.005s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.quota [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Created reservations ['41c3d090-d2bc-4476-bab5-d0e6452207bb', 'ac0bef01-78fe-4199-bf57-c33d78401ccb', 'fd8826a0-22f4-4136-846d-f3bc26d6ebf1', '3658c8df-9d32-445d-8f3c-d1e6e744a7a5'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:58:50 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.501s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Deleted volume successfully. Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f2f80647-37dd-4451-90df-082fb8d9157d tempest-VolumesListTestJSON-283431954 None] Lock "cinder-673260e3-af2a-49a8-aee9-eb571ccd2150-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:50 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:58:50 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:51 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.manager [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:58:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Deleted volume successfully. Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [req-aa1d47db-a593-4660-ac0f-5c9f6070aa79 req-93463326-f070-42ca-871c-45d52dd6cef5 tempest-ServerBootFromVolumeStableRescueTest-202513406 None] Lock "cinder-35a3c178-4236-4706-92e7-e98f5a72d516-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Flow 'volume_create_manager' (30adc746-2b40-4c94-bda6-065e573fb40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e61b3-dee5-42b6-bb9c-ae804f30fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e61b3-dee5-42b6-bb9c-ae804f30fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-440177005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85005073-8942-4968-b874-3eff308bdcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6bcc810814418f8ecded854faca5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:52Z,use_quota=True,user_id='f333a2981ed84e12af5559725087b622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef22f1e-b926-4c99-a0c0-7ddaddff0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef22f1e-b926-4c99-a0c0-7ddaddff0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d480b656-99ae-43db-9f4e-d92794445cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d480b656-99ae-43db-9f4e-d92794445cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85005073-8942-4968-b874-3eff308bdcf1', 'volume_name': 'volume-85005073-8942-4968-b874-3eff308bdcf1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f51f9c-f2fc-4109-9506-219e7b346c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f51f9c-f2fc-4109-9506-219e7b346c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322d5595-83cb-4e08-8f9f-6680faec2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:51 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Volume 85005073-8942-4968-b874-3eff308bdcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85005073-8942-4968-b874-3eff308bdcf1', 'volume_size': 1} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-440177005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85005073-8942-4968-b874-3eff308bdcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6bcc810814418f8ecded854faca5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:58:52Z,use_quota=True,user_id='f333a2981ed84e12af5559725087b622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Creating volume 85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:58:51 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:58:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:51 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 1073741824 Apr 02 19:58:51 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:52 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 1073741824" returned: 0 in 0.595s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:52 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 Apr 02 19:58:52 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:53 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1" returned: 0 in 0.520s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322d5595-83cb-4e08-8f9f-6680faec2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85005073-8942-4968-b874-3eff308bdcf1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4bf82a-90e9-418a-836c-5a27623a0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:58:53 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Volume volume-85005073-8942-4968-b874-3eff308bdcf1 (85005073-8942-4968-b874-3eff308bdcf1): created successfully Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4bf82a-90e9-418a-836c-5a27623a0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:58:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Flow 'volume_create_manager' (30adc746-2b40-4c94-bda6-065e573fb40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:58:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-de4452b4-8b7f-4073-9c83-752de6cf6f69 tempest-SnapshotMetadataTestJSON-760047193 None] Created volume successfully. Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Creating offline snapshot 8225aeba-c469-4781-ad9f-bf8907b4d40e of volume 85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe9ccf-def1-422d-907d-3f7f90c49edd]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:54 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 Apr 02 19:58:54 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:54 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1" returned: 0 in 0.553s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:54 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e 1G Apr 02 19:58:54 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:55 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e 1G" returned: 0 in 0.592s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85005073-8942-4968-b874-3eff308bdcf1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:55 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85005073-8942-4968-b874-3eff308bdcf1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e Apr 02 19:58:55 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:55 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85005073-8942-4968-b874-3eff308bdcf1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e" returned: 0 in 0.456s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:55 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e is being set with open permissions: ugo+rw Apr 02 19:58:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:55 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e Apr 02 19:58:55 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:56 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:56 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info Apr 02 19:58:56 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:56 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info" returned: 0 in 0.471s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:56 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info is being set with open permissions: ugo+rw Apr 02 19:58:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:56 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info Apr 02 19:58:56 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:57 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.info" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:58:57 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d883eb57-e76d-44f5-947a-2399e971087f tempest-SnapshotMetadataTestJSON-760047193 None] Create snapshot completed successfully Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "cinder-8225aeba-c469-4781-ad9f-bf8907b4d40e-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-8225aeba-c469-4781-ad9f-bf8907b4d40e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "cinder-quobyte-8225aeba-c469-4781-ad9f-bf8907b4d40e" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-8225aeba-c469-4781-ad9f-bf8907b4d40e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Deleting offline snapshot 8225aeba-c469-4781-ad9f-bf8907b4d40e of volume 85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] snapshot_file for this snap is: volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e427209-c174-42e1-ae1b-67e4ea3f6007]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:58 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e Apr 02 19:58:58 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:59 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85005073-8942-4968-b874-3eff308bdcf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c5b12-e2ca-4728-937a-452433d905eb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:58:59 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 Apr 02 19:58:59 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:58:59 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1" returned: 0 in 0.579s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:58:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:00 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e Apr 02 19:59:00 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:00 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:00 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e Apr 02 19:59:00 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:00 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1.8225aeba-c469-4781-ad9f-bf8907b4d40e" returned: 0 in 0.503s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-8225aeba-c469-4781-ad9f-bf8907b4d40e" released by "_delete_snapshot" :: held 2.160s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" released by "delete_snapshot" :: held 2.175s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:01 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Created reservations ['471c0f3c-9f24-4e94-b8fb-27b6b6bbd2b4', '8be56f26-682b-4e4e-8ed8-a26ab28ed0bc', 'a08390c3-4c0f-4cec-8317-0bbb2c22ac7a', '3fdbdbf4-2771-4bac-a293-d81c8d20da35'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Delete snapshot completed successfully. Apr 02 19:59:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3dd2ee49-435f-4ee8-b24f-bc141bf5442a tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-8225aeba-c469-4781-ad9f-bf8907b4d40e-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "cinder-85005073-8942-4968-b874-3eff308bdcf1-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-85005073-8942-4968-b874-3eff308bdcf1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" acquired by "delete_volume" :: waited 0.023s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bd8ea-ffb0-494b-95b1-09082549557d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:02 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 Apr 02 19:59:02 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:02 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1" returned: 0 in 0.557s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:02 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1 Apr 02 19:59:02 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:03 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-85005073-8942-4968-b874-3eff308bdcf1" returned: 0 in 0.517s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-quobyte-85005073-8942-4968-b874-3eff308bdcf1" released by "delete_volume" :: held 1.120s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Created reservations ['3f1a99ae-eca8-4b59-a98f-2d187df05965', 'f0392976-62c7-413a-8cf9-c736f69000cd', '7e94992a-b5ad-461e-a1a0-28a591b92e50', '0f9738e5-1036-46f3-acf0-67114d8c61d6'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:03 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:03 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:03 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Deleted volume successfully. Apr 02 19:59:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cddfb708-9d2d-4401-bf61-9d394d670a4e tempest-SnapshotMetadataTestJSON-760047193 None] Lock "cinder-85005073-8942-4968-b874-3eff308bdcf1-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:06 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:06 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:07 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.678s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Flow 'volume_create_manager' (17d0b5dd-0e61-4071-9491-e88fb80f7852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f54ea-2c99-458b-9749-4fbe79e89aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f54ea-2c99-458b-9749-4fbe79e89aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1367323167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219522cb-9e5e-4587-afb3-d1c587ddd98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1678f496824d4395a0d52b3d8d1a5964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:07Z,use_quota=True,user_id='4ba036906b964241b94eb5a130107da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd36255-0261-44e0-b932-3c5304d9318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd36255-0261-44e0-b932-3c5304d9318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622202b6-eb64-453a-ac22-f5525816de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622202b6-eb64-453a-ac22-f5525816de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219522cb-9e5e-4587-afb3-d1c587ddd98f', 'volume_name': 'volume-219522cb-9e5e-4587-afb3-d1c587ddd98f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a0c9e5-4d76-4978-9434-f13f4a84697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a0c9e5-4d76-4978-9434-f13f4a84697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26543e0-6c51-40d0-90b0-04b8f4c9abdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Volume 219522cb-9e5e-4587-afb3-d1c587ddd98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219522cb-9e5e-4587-afb3-d1c587ddd98f', 'volume_size': 1} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1367323167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219522cb-9e5e-4587-afb3-d1c587ddd98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1678f496824d4395a0d52b3d8d1a5964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:07Z,use_quota=True,user_id='4ba036906b964241b94eb5a130107da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Creating volume 219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:07 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:07 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f 1073741824 Apr 02 19:59:07 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (857c19a6-5c61-4f78-921e-c84c723f8323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2b1105-4783-41f0-8aeb-50290d8888e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2b1105-4783-41f0-8aeb-50290d8888e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260377389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aac805-03f9-4818-bb70-f2d4c767f0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a7c53b1fe4dadb82fcfa7ce7ecc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:08Z,use_quota=True,user_id='1cbc88ce8a6a46ceba3a9f2b98512796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322c03b-0ccc-4066-9234-f9956dc3237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322c03b-0ccc-4066-9234-f9956dc3237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d974a7e-618b-4f78-ae05-63f2343c920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d974a7e-618b-4f78-ae05-63f2343c920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47aac805-03f9-4818-bb70-f2d4c767f0b4', 'volume_name': 'volume-47aac805-03f9-4818-bb70-f2d4c767f0b4', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9e9bb-e435-4d87-b625-ec90a0ab5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9e9bb-e435-4d87-b625-ec90a0ab5db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50664890-ae3f-4b6e-8e34-a9532c9c56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Volume 47aac805-03f9-4818-bb70-f2d4c767f0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47aac805-03f9-4818-bb70-f2d4c767f0b4', 'volume_size': 1} Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:07 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f 1073741824" returned: 0 in 0.464s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:08 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:08 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:08 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.450s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260377389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aac805-03f9-4818-bb70-f2d4c767f0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a7c53b1fe4dadb82fcfa7ce7ecc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:08Z,use_quota=True,user_id='1cbc88ce8a6a46ceba3a9f2b98512796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Creating volume 47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:08 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26543e0-6c51-40d0-90b0-04b8f4c9abdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219522cb-9e5e-4587-afb3-d1c587ddd98f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8189864-d8e9-4de5-a852-a6139d672390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:08 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Volume volume-219522cb-9e5e-4587-afb3-d1c587ddd98f (219522cb-9e5e-4587-afb3-d1c587ddd98f): created successfully Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8189864-d8e9-4de5-a852-a6139d672390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:08 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 1073741824 Apr 02 19:59:08 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Flow 'volume_create_manager' (17d0b5dd-0e61-4071-9491-e88fb80f7852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:08 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c0237582-5f72-4b6f-914d-79fb1880343e tempest-SnapshotDependencyTests-231918744 None] Created volume successfully. Apr 02 19:59:09 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 1073741824" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:09 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 Apr 02 19:59:09 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:09 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50664890-ae3f-4b6e-8e34-a9532c9c56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47aac805-03f9-4818-bb70-f2d4c767f0b4', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f860ca98-1eec-4979-b090-6db644e15811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Volume volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 (47aac805-03f9-4818-bb70-f2d4c767f0b4): created successfully Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f860ca98-1eec-4979-b090-6db644e15811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (857c19a6-5c61-4f78-921e-c84c723f8323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-972063be-5784-4310-9f2b-0d840d462c61 tempest-VolumesDeleteCascade-803745158 None] Created volume successfully. Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Creating offline snapshot e49c2ebf-3cd9-40c1-bb9a-849847eeff64 of volume 219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[96907544-ba27-413b-a013-d48ea0db0c00]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:09 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:09 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:10 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.549s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:10 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 1G Apr 02 19:59:10 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:10 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 1G" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219522cb-9e5e-4587-afb3-d1c587ddd98f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:10 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219522cb-9e5e-4587-afb3-d1c587ddd98f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:10 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:11 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219522cb-9e5e-4587-afb3-d1c587ddd98f -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:11 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 is being set with open permissions: ugo+rw Apr 02 19:59:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:11 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:11 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:11 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:11 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info Apr 02 19:59:11 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:12 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info" returned: 0 in 0.515s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:12 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info is being set with open permissions: ugo+rw Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:12 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info Apr 02 19:59:12 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:12 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.info" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.018s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Creating offline snapshot 7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 of volume 47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:59:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-36a09c24-2ddf-4b5b-aaa1-27725607aa54 tempest-SnapshotDependencyTests-231918744 None] Create snapshot completed successfully Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6ca483-7284-4947-bee4-6f6f4fb84079]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:12 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 Apr 02 19:59:12 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:13 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:13 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 1G Apr 02 19:59:13 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:13 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 1G" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:13 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:13 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:14 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:14 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 is being set with open permissions: ugo+rw Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:14 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:14 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Flow 'volume_create_manager' (a7ee6757-6390-4354-b811-dfa272313384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb54caf4-5a84-4fe8-b12e-2bbfe1c605cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb54caf4-5a84-4fe8-b12e-2bbfe1c605cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bedbf9-c7c1-4c3c-945e-1fd78450ee5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1678f496824d4395a0d52b3d8d1a5964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e49c2ebf-3cd9-40c1-bb9a-849847eeff64,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:14Z,use_quota=True,user_id='4ba036906b964241b94eb5a130107da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab7b3d2-0a0a-4155-8850-b4990dae1d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab7b3d2-0a0a-4155-8850-b4990dae1d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44507a2-cfe1-4a8e-a9f7-9e3173ad244e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44507a2-cfe1-4a8e-a9f7-9e3173ad244e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '30bedbf9-c7c1-4c3c-945e-1fd78450ee5e', 'volume_name': 'volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e', 'volume_size': 1, 'snapshot_id': 'e49c2ebf-3cd9-40c1-bb9a-849847eeff64'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38d696a-2530-4d6f-a26f-fac02a913d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38d696a-2530-4d6f-a26f-fac02a913d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcd8e03-9696-4fc1-917b-596f5cc2caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Volume 30bedbf9-c7c1-4c3c-945e-1fd78450ee5e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e', 'volume_size': 1, 'snapshot_id': 'e49c2ebf-3cd9-40c1-bb9a-849847eeff64'} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:14 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:14 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info Apr 02 19:59:14 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:15 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info" returned: 0 in 0.383s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:15 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info is being set with open permissions: ugo+rw Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:15 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info Apr 02 19:59:15 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:15 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.info" returned: 0 in 0.412s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.155s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=154,cinder:INSERT=45,cinder:UPDATE=199,cinder:DELETE=20 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=169,cinder:UPDATE=221,cinder:DELETE=13,cinder:INSERT=62 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 19:59:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2bfcf45d-3dfc-4ffc-a2b2-d2d277ded3ce tempest-VolumesDeleteCascade-803745158 None] Create snapshot completed successfully Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Creating volume 30bedbf9-c7c1-4c3c-945e-1fd78450ee5e from snapshot e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] snapshot: e49c2ebf-3cd9-40c1-bb9a-849847eeff64, volume: 30bedbf9-c7c1-4c3c-945e-1fd78450ee5e, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e07682-5eaa-4771-9d6f-b0a58e2f3533]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:15 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:15 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:16 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.471s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-219522cb-9e5e-4587-afb3-d1c587ddd98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925a7c7-fc5f-422f-a220-a767acf365ab]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:16 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:16 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:16 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.575s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 19:59:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:16 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e Apr 02 19:59:16 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:19 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" returned: 0 in 2.407s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26048e7-fc34-40b0-8cdc-b6edbc6f19a1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:19 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:19 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:19 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.575s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:59:19 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Converted 1024.00 MB image at 425.23 MB/s Apr 02 19:59:19 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e is being set with open permissions: ugo+rw Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:19 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e Apr 02 19:59:19 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:19 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" released by "_copy_volume_from_snapshot" :: held 4.469s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" released by "_create_volume_from_snapshot" :: held 4.497s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.526s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.870s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcd8e03-9696-4fc1-917b-596f5cc2caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e', 'volume_size': 1, 'snapshot_id': 'e49c2ebf-3cd9-40c1-bb9a-849847eeff64'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2e02a-ca9d-47b2-b479-94b9de07bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Creating offline snapshot 5deeea1e-8b92-486e-bbd9-c64407223977 of volume 47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:59:20 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Volume volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e (30bedbf9-c7c1-4c3c-945e-1fd78450ee5e): created successfully Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2e02a-ca9d-47b2-b479-94b9de07bae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Flow 'volume_create_manager' (a7ee6757-6390-4354-b811-dfa272313384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8835e3a-c8ca-44e1-87c3-7f4064f1cfd8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4bd871f6-d688-4449-8fdd-d8305883e33c tempest-SnapshotDependencyTests-231918744 None] Created volume successfully. Apr 02 19:59:20 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:20 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:20 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.522s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47aac805-03f9-4818-bb70-f2d4c767f0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:20 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 1G Apr 02 19:59:20 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Deleting offline snapshot e49c2ebf-3cd9-40c1-bb9a-849847eeff64 of volume 219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] snapshot_file for this snap is: volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5cbc06-350f-45eb-bdc1-66ac4fccef75]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:21 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:21 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:21 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 1G" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:21 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 Apr 02 19:59:21 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:21 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.502s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-219522cb-9e5e-4587-afb3-d1c587ddd98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ac80d-8399-4923-ada4-2236a5ae3383]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:21 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:21 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:21 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:21 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 is being set with open permissions: ugo+rw Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:21 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 Apr 02 19:59:21 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:21 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:21 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:21 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:21 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-53c400c3-5ebb-43b7-9ca6-c8349354abd4 tempest-VolumesDeleteCascade-803745158 None] Create snapshot completed successfully Apr 02 19:59:22 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:22 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64 Apr 02 19:59:22 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-47aac805-03f9-4818-bb70-f2d4c767f0b4-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-47aac805-03f9-4818-bb70-f2d4c767f0b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Performing cascade delete. {{(pid=82597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-5deeea1e-8b92-486e-bbd9-c64407223977-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-5deeea1e-8b92-486e-bbd9-c64407223977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-5deeea1e-8b92-486e-bbd9-c64407223977" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-5deeea1e-8b92-486e-bbd9-c64407223977" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Deleting offline snapshot 5deeea1e-8b92-486e-bbd9-c64407223977 of volume 47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] snapshot_file for this snap is: volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c7e74-4347-43aa-b35f-b956371a4ef2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:22 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 Apr 02 19:59:22 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:22 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f.e49c2ebf-3cd9-40c1-bb9a-849847eeff64" returned: 0 in 0.473s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-e49c2ebf-3cd9-40c1-bb9a-849847eeff64" released by "_delete_snapshot" :: held 1.913s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" released by "delete_snapshot" :: held 1.928s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Created reservations ['853889c9-d49c-432a-9be4-33f1512a47f0', 'ce5205e3-33b6-4b55-9e34-1c10f31a447e', '9db704f7-fd0c-4578-864c-15a765f0f90e', 'c87fc6e6-2f0d-46b3-959b-f451c96579b0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Delete snapshot completed successfully. Apr 02 19:59:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e7011fc9-b417-484b-b5fb-216153f11c24 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-e49c2ebf-3cd9-40c1-bb9a-849847eeff64-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-219522cb-9e5e-4587-afb3-d1c587ddd98f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-219522cb-9e5e-4587-afb3-d1c587ddd98f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f61fd52-946c-4c89-b493-22be5d1d3640]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:23 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:23 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:23 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977" returned: 0 in 0.670s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47aac805-03f9-4818-bb70-f2d4c767f0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8145f4-6669-4c73-a98d-08a8eee47c2f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:23 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:23 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:23 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.607s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:23 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f Apr 02 19:59:23 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:23 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.641s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47aac805-03f9-4818-bb70-f2d4c767f0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:23 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 Apr 02 19:59:23 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:24 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-219522cb-9e5e-4587-afb3-d1c587ddd98f" returned: 0 in 0.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-219522cb-9e5e-4587-afb3-d1c587ddd98f" released by "delete_volume" :: held 1.158s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Created reservations ['160bee25-bc98-47ed-9575-a893c19eab1e', '49f5f6f1-5689-4dd0-9ac7-966ec4a2bc3d', '1ca213c2-affc-4bcf-a511-665a0eafabb5', 'c1d786ef-ef58-4e0d-ba2d-5b8b94974afd'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:24 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:24 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:24 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977" returned: 0 in 0.553s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:24 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977 Apr 02 19:59:24 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:24 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Deleted volume successfully. Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fc942b6c-253b-42f4-adbb-0575b26aa915 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-219522cb-9e5e-4587-afb3-d1c587ddd98f-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:24 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.5deeea1e-8b92-486e-bbd9-c64407223977" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-5deeea1e-8b92-486e-bbd9-c64407223977" released by "_delete_snapshot" :: held 2.383s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" released by "delete_snapshot" :: held 2.393s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:24 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Created reservations ['a4405e9a-1f03-439c-8e51-fa7638515986', 'e11c24d7-1446-4f3f-a1be-4305a73f77e9', '609c47f7-fd56-491c-9a07-00c11081d14d', '22749767-833d-405f-8d41-17b8e26c20f2'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Delete snapshot completed successfully. Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-5deeea1e-8b92-486e-bbd9-c64407223977-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Deleting offline snapshot 7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 of volume 47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] snapshot_file for this snap is: volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20eca1-47bd-4b89-9de3-d1449dd0680e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:25 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:25 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" acquired by "delete_volume" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaf0bef-b9e9-4dc2-af8d-22a692150080]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:25 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e Apr 02 19:59:25 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:25 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.687s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47aac805-03f9-4818-bb70-f2d4c767f0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d491ba-15ab-413e-83e2-477277dc24ec]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:25 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 Apr 02 19:59:25 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:25 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" returned: 0 in 0.602s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:26 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e Apr 02 19:59:26 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:26 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4" returned: 0 in 0.513s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:26 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:26 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:26 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-quobyte-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e" released by "delete_volume" :: held 1.087s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Created reservations ['4d90b674-c831-4d55-8a7c-9be85885f1fc', '72d449a9-ee1e-4aac-841d-6d6cff91fca1', '546e0a30-2e6b-4060-847b-c81305fd8472', 'c5ab02a0-8b75-4211-8194-2f3413abdfe5'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:26 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:26 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:26 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.568s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:26 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8 Apr 02 19:59:26 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:27 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Deleted volume successfully. Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b3d480db-d91d-42d4-91d7-87b99afd83d6 tempest-SnapshotDependencyTests-231918744 None] Lock "cinder-30bedbf9-c7c1-4c3c-945e-1fd78450ee5e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:27 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4.7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" returned: 0 in 0.411s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8" released by "_delete_snapshot" :: held 2.252s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" released by "delete_snapshot" :: held 2.261s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Created reservations ['9692968f-7720-48d8-aa77-be7094888b8a', 'cd6e1075-aa66-4fb6-b531-e9aec9bcda8d', '0e2c5a53-7233-4272-a085-f495c943636a', '7529e2e1-c6d0-484b-a569-570f911aaf67'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Delete snapshot completed successfully. Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-7598031e-d6b2-4ab0-b38a-7f33b6fbd0a8-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Snapshots deleted, issuing volume delete {{(pid=82597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" acquired by "delete_volume" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208647f-3ec3-440e-a501-0325cd631235]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:27 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 Apr 02 19:59:27 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:27 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4" returned: 0 in 0.527s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:28 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4 Apr 02 19:59:28 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:28 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-47aac805-03f9-4818-bb70-f2d4c767f0b4" returned: 0 in 0.471s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-47aac805-03f9-4818-bb70-f2d4c767f0b4" released by "delete_volume" :: held 1.041s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Created reservations ['e2c516b3-51a5-4e40-8e7c-71be11588ebf', '360bee06-ad18-4561-ab1e-dabad95d6d29', '8ba3c264-272c-4a12-b13a-2517d28c1890', '42c144e4-6a77-4aa9-9ca7-dc6da80163c4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:28 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:28 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:29 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.502s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Deleted volume successfully. Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4abc5c66-f708-47fb-a1a1-c21dad83444a tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-47aac805-03f9-4818-bb70-f2d4c767f0b4-delete_volume" released by "delete_volume" :: held 6.634s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (8b50938c-dab8-4686-b5f8-3eaaf0132c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5312ae-9fe4-43e2-b527-e4340025362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5312ae-9fe4-43e2-b527-e4340025362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1310567295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a7c53b1fe4dadb82fcfa7ce7ecc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:29Z,use_quota=True,user_id='1cbc88ce8a6a46ceba3a9f2b98512796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3d412b-f679-4ad4-bc65-157202f11063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3d412b-f679-4ad4-bc65-157202f11063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ce340-7277-4ff3-9ad2-b499d619bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ce340-7277-4ff3-9ad2-b499d619bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1', 'volume_name': 'volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de2da06-4f2c-4a02-a8f7-07aa4945f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de2da06-4f2c-4a02-a8f7-07aa4945f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44209122-4581-48a6-af44-5a078c5aaea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:29 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Volume c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1', 'volume_size': 1} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1310567295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a7c53b1fe4dadb82fcfa7ce7ecc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:29Z,use_quota=True,user_id='1cbc88ce8a6a46ceba3a9f2b98512796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Creating volume c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:29 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:29 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 1073741824 Apr 02 19:59:29 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:30 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 1073741824" returned: 0 in 0.586s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:30 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:30 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:30 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.705s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44209122-4581-48a6-af44-5a078c5aaea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dab588a-2148-4676-ad1c-3f6609b173c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:30 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Volume volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 (c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1): created successfully Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dab588a-2148-4676-ad1c-3f6609b173c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (8b50938c-dab8-4686-b5f8-3eaaf0132c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d6cb5eca-b219-49b6-8fc7-34b015a5d35d tempest-VolumesDeleteCascade-803745158 None] Created volume successfully. Apr 02 19:59:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Creating offline snapshot e20e10ee-49bf-4668-824a-820c1fc90f8d of volume c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 19:59:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2f3d5d-bf56-48b6-820f-541c5054b50d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:31 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:31 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:32 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.542s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:32 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d 1G Apr 02 19:59:32 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:32 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d 1G" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:32 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:32 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:33 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.520s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:33 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d is being set with open permissions: ugo+rw Apr 02 19:59:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:33 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:33 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:34 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.629s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:34 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info Apr 02 19:59:34 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:34 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info" returned: 0 in 0.528s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:34 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info is being set with open permissions: ugo+rw Apr 02 19:59:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:34 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info Apr 02 19:59:34 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:35 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.info" returned: 0 in 0.570s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.453s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:35 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7d1e5135-1e8a-43bd-b894-bd025e049774 tempest-VolumesDeleteCascade-803745158 None] Create snapshot completed successfully Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (60c57e23-959e-447a-922b-0730c3297918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade8296-847d-40c7-92db-2ce5f71d5f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ade8296-847d-40c7-92db-2ce5f71d5f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1780359351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e7bcf-cc80-4fac-a38d-e8c86d171815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a7c53b1fe4dadb82fcfa7ce7ecc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e20e10ee-49bf-4668-824a-820c1fc90f8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:36Z,use_quota=True,user_id='1cbc88ce8a6a46ceba3a9f2b98512796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826ac0cc-c0f9-4941-bbf6-365300cb0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826ac0cc-c0f9-4941-bbf6-365300cb0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13df95b3-07b9-4ca3-9314-af96a1809e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13df95b3-07b9-4ca3-9314-af96a1809e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e83e7bcf-cc80-4fac-a38d-e8c86d171815', 'volume_name': 'volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815', 'volume_size': 1, 'snapshot_id': 'e20e10ee-49bf-4668-824a-820c1fc90f8d'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab2224-3714-4ea8-bb98-2261eafc71df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab2224-3714-4ea8-bb98-2261eafc71df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52726ff-43d0-4524-ad40-7ab2eab9986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:36 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Volume e83e7bcf-cc80-4fac-a38d-e8c86d171815: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815', 'volume_size': 1, 'snapshot_id': 'e20e10ee-49bf-4668-824a-820c1fc90f8d'} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d-e83e7bcf-cc80-4fac-a38d-e8c86d171815" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d-e83e7bcf-cc80-4fac-a38d-e8c86d171815" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Creating volume e83e7bcf-cc80-4fac-a38d-e8c86d171815 from snapshot e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] snapshot: e20e10ee-49bf-4668-824a-820c1fc90f8d, volume: e83e7bcf-cc80-4fac-a38d-e8c86d171815, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb3bcb-d540-464b-9b78-d675fc0484e2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:36 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:36 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:36 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.580s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdd639b-246a-4673-9ef6-95210f500dd6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:36 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:36 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:37 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.674s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:37 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 19:59:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:37 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 Apr 02 19:59:37 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:40 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815" returned: 0 in 3.123s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:40 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b048d1d0-484e-4e99-83a5-84f72b5ca8c5]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:40 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:40 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:41 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.620s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1, size 1024.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 19:59:41 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Converted 1024.00 MB image at 327.78 MB/s Apr 02 19:59:41 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 is being set with open permissions: ugo+rw Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:41 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 Apr 02 19:59:41 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:41 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815" returned: 0 in 0.402s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" released by "_copy_volume_from_snapshot" :: held 5.459s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d-e83e7bcf-cc80-4fac-a38d-e8c86d171815" released by "_create_volume_from_snapshot" :: held 5.482s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.492s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52726ff-43d0-4524-ad40-7ab2eab9986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815', 'volume_size': 1, 'snapshot_id': 'e20e10ee-49bf-4668-824a-820c1fc90f8d'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df2270-76d0-4175-9cc9-a6d0907c7757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Volume volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 (e83e7bcf-cc80-4fac-a38d-e8c86d171815): created successfully Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92df2270-76d0-4175-9cc9-a6d0907c7757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Flow 'volume_create_manager' (60c57e23-959e-447a-922b-0730c3297918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6827e6a9-8909-42f8-b562-9f5b8df021ca tempest-VolumesDeleteCascade-803745158 None] Created volume successfully. Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Performing cascade delete. {{(pid=82597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-e20e10ee-49bf-4668-824a-820c1fc90f8d-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-e20e10ee-49bf-4668-824a-820c1fc90f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Deleting offline snapshot e20e10ee-49bf-4668-824a-820c1fc90f8d of volume c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] snapshot_file for this snap is: volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce60a6-8c03-49d7-9d59-9cb87bce81cb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:42 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:42 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:43 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.463s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c8e0f-eb94-449e-96fc-5862b227eb83]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:43 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:43 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:43 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:43 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:43 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:44 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:44 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d Apr 02 19:59:44 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:44 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1.e20e10ee-49bf-4668-824a-820c1fc90f8d" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e20e10ee-49bf-4668-824a-820c1fc90f8d" released by "_delete_snapshot" :: held 1.833s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" released by "delete_snapshot" :: held 1.847s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Created reservations ['78a04cd4-dfd8-461b-a117-8335edd068ee', 'a203854c-4abf-491e-91b1-f33216cd5189', 'e339fc63-68a7-4f91-a805-bd71c739ca76', 'fe97f869-d7da-444e-8cf9-5f750e2462e9'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Delete snapshot completed successfully. Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-e20e10ee-49bf-4668-824a-820c1fc90f8d-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Snapshots deleted, issuing volume delete {{(pid=82597) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" acquired by "delete_volume" :: waited 0.005s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[78737d01-2224-4c47-9caf-0f6289f75a96]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:44 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:44 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:45 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:45 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1 Apr 02 19:59:45 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:45 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" returned: 0 in 0.399s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1" released by "delete_volume" :: held 0.883s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Created reservations ['27c50295-621e-4c9b-b85e-21356ce67ab1', 'a2cb6f9f-2da1-4114-97f5-78e415c2f5fe', '2e0cddd1-7608-44fc-8bf5-7ef272cb42f9', '53343088-4e58-4854-b4c1-423264450074'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:45 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:45 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-e83e7bcf-cc80-4fac-a38d-e8c86d171815-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-e83e7bcf-cc80-4fac-a38d-e8c86d171815-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a9a25-d0d4-4573-b434-0de1edcec77e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:46 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Deleted volume successfully. Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cac2dbf4-75b9-4cc9-903b-339f634d3b91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-c52cc793-ff6a-4abd-9e1f-b4e45ad0acc1-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:46 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 Apr 02 19:59:46 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Flow 'volume_create_manager' (fbb3f7ec-0b9f-4bf7-a1a2-2f6e39f33fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15b06d8-5806-43a7-8ce3-831b5b97f1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15b06d8-5806-43a7-8ce3-831b5b97f1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-159253010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44219fab13854614a390de468f403a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:47Z,use_quota=True,user_id='753cddc037ec41cb8c275823cc21545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eec5313-39e1-4b93-b031-ced04d9a9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eec5313-39e1-4b93-b031-ced04d9a9244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d303418-0b4c-4ab5-a520-87d3060b036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d303418-0b4c-4ab5-a520-87d3060b036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2', 'volume_name': 'volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93e8409-f186-46c7-bcd3-3c3af8468d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93e8409-f186-46c7-bcd3-3c3af8468d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9768ce5-701f-4c97-a221-d55abb8cac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Volume 6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2', 'volume_size': 1} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-159253010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44219fab13854614a390de468f403a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:47Z,use_quota=True,user_id='753cddc037ec41cb8c275823cc21545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Creating volume 6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:46 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:46 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815" returned: 0 in 0.576s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:46 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 1073741824 Apr 02 19:59:46 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:46 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815 Apr 02 19:59:46 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:47 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e83e7bcf-cc80-4fac-a38d-e8c86d171815" returned: 0 in 0.410s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-quobyte-e83e7bcf-cc80-4fac-a38d-e8c86d171815" released by "delete_volume" :: held 1.013s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Created reservations ['5d49c674-72d2-4281-b1bd-32f50b7e4e9e', 'f9d688ff-ad71-45bc-9c7a-50b27807ee7d', 'cfcc9e2c-9435-44da-ab2f-1341eb594dac', '87fb8381-86ba-4dea-accd-7ad638aa8851'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:47 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 1073741824" returned: 0 in 0.538s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:47 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:47 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:47 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 Apr 02 19:59:47 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:47 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Deleted volume successfully. Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beffc9ae-ef88-4c88-96ef-afb32381fe91 tempest-VolumesDeleteCascade-803745158 None] Lock "cinder-e83e7bcf-cc80-4fac-a38d-e8c86d171815-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:47 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9768ce5-701f-4c97-a221-d55abb8cac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30a9db5-8ff4-44b8-afb9-9e7d76dc83cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:47 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Volume volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 (6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2): created successfully Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30a9db5-8ff4-44b8-afb9-9e7d76dc83cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Flow 'volume_create_manager' (fbb3f7ec-0b9f-4bf7-a1a2-2f6e39f33fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0be111c0-ddb6-463f-af42-9bd29abc63bd tempest-ServersNegativeTestJSON-2076719180 None] Created volume successfully. Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Flow 'volume_create_manager' (c09b693e-b3a7-492f-8580-e76a1d30f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0482ff5d-34c0-4ed4-b1d8-f1bb03e8c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0482ff5d-34c0-4ed4-b1d8-f1bb03e8c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1285511537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018e081f-af08-4920-9d0b-3096441f6fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44219fab13854614a390de468f403a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:50Z,use_quota=True,user_id='753cddc037ec41cb8c275823cc21545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae38688-1152-43bc-9fbd-fd4ec6c244e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae38688-1152-43bc-9fbd-fd4ec6c244e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a5d87e-9f0c-47af-a88b-2c484644c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a5d87e-9f0c-47af-a88b-2c484644c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018e081f-af08-4920-9d0b-3096441f6fa9', 'volume_name': 'volume-018e081f-af08-4920-9d0b-3096441f6fa9', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e256883d-a3d6-44bd-9348-bff7cef034e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e256883d-a3d6-44bd-9348-bff7cef034e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0311283b-800c-4e5f-bbd8-9893f4bd65d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Volume 018e081f-af08-4920-9d0b-3096441f6fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018e081f-af08-4920-9d0b-3096441f6fa9', 'volume_size': 1} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1285511537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018e081f-af08-4920-9d0b-3096441f6fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44219fab13854614a390de468f403a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:50Z,use_quota=True,user_id='753cddc037ec41cb8c275823cc21545d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Creating volume 018e081f-af08-4920-9d0b-3096441f6fa9 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:49 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:49 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 1073741824 Apr 02 19:59:49 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:50 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 1073741824" returned: 0 in 0.580s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:50 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 Apr 02 19:59:50 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:50 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9" returned: 0 in 0.443s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0311283b-800c-4e5f-bbd8-9893f4bd65d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018e081f-af08-4920-9d0b-3096441f6fa9', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740b1f1-bf41-43dd-a94b-1bba61463f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:50 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Volume volume-018e081f-af08-4920-9d0b-3096441f6fa9 (018e081f-af08-4920-9d0b-3096441f6fa9): created successfully Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5740b1f1-bf41-43dd-a94b-1bba61463f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Flow 'volume_create_manager' (c09b693e-b3a7-492f-8580-e76a1d30f54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a04cf896-a483-4a07-9906-bc9873ebc217 tempest-ServersNegativeTestJSON-2076719180 None] Created volume successfully. Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Flow 'volume_create_manager' (deeec8e4-322c-428c-8450-702f5204f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f324b0-7285-4158-946c-14844cd93592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f324b0-7285-4158-946c-14844cd93592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1492000844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7f239d-fe67-4413-a5ca-0260f53a1992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f2cf4aeba64b448cf4fa69a013f13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:51Z,use_quota=True,user_id='e229a9ac4853405c98b3d5c13ff7458d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112dcf-bf27-466f-bfc3-5e6b37fb913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112dcf-bf27-466f-bfc3-5e6b37fb913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d33d00-3de0-4654-8434-a65cfb22a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d33d00-3de0-4654-8434-a65cfb22a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7f239d-fe67-4413-a5ca-0260f53a1992', 'volume_name': 'volume-0c7f239d-fe67-4413-a5ca-0260f53a1992', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770c1925-3d26-4a51-a7ac-7b165a549c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770c1925-3d26-4a51-a7ac-7b165a549c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6f96a0-c6f9-46b3-abbb-679a2123f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:51 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Volume 0c7f239d-fe67-4413-a5ca-0260f53a1992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7f239d-fe67-4413-a5ca-0260f53a1992', 'volume_size': 1} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1492000844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7f239d-fe67-4413-a5ca-0260f53a1992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f2cf4aeba64b448cf4fa69a013f13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:51Z,use_quota=True,user_id='e229a9ac4853405c98b3d5c13ff7458d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Creating volume 0c7f239d-fe67-4413-a5ca-0260f53a1992 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:51 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:51 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 1073741824 Apr 02 19:59:51 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:51 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 1073741824" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:51 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 Apr 02 19:59:51 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:52 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6f96a0-c6f9-46b3-abbb-679a2123f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7f239d-fe67-4413-a5ca-0260f53a1992', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafd6b7c-012e-449b-b2b0-ac914351c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:52 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Volume volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 (0c7f239d-fe67-4413-a5ca-0260f53a1992): created successfully Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafd6b7c-012e-449b-b2b0-ac914351c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Flow 'volume_create_manager' (deeec8e4-322c-428c-8450-702f5204f355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:52 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4d296de9-4fcb-4eb5-81bc-0c12e965d696 tempest-VolumesTransfersV357Test-598885002 None] Created volume successfully. Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "cinder-018e081f-af08-4920-9d0b-3096441f6fa9-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-018e081f-af08-4920-9d0b-3096441f6fa9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "cinder-quobyte-018e081f-af08-4920-9d0b-3096441f6fa9" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-quobyte-018e081f-af08-4920-9d0b-3096441f6fa9" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194e105-3c60-4c83-aff8-014e381c8456]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:52 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 Apr 02 19:59:52 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:52 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:52 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9 Apr 02 19:59:52 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:53 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-018e081f-af08-4920-9d0b-3096441f6fa9" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-quobyte-018e081f-af08-4920-9d0b-3096441f6fa9" released by "delete_volume" :: held 0.884s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Created reservations ['99670858-72df-4c98-bd0f-b26290679bb6', '210380e7-756e-464d-ac4f-986482a71b73', '0e7d9927-42e6-4dde-b6e5-fd346409a7db', 'f29faba4-6edf-4a93-a593-8a600f559947'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:53 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:53 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "cinder-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "cinder-quobyte-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-quobyte-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264b439-deab-4696-95fe-d02e5e5821fd]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:53 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 Apr 02 19:59:53 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b0620840-af3e-4379-abf9-bd9c4c2d0957 tempest-VolumesTransfersV357Test-848609694 None] Transfer volume completed successfully. Apr 02 19:59:53 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.509s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Deleted volume successfully. Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-62e374d8-dd29-47bc-b603-32771e6e071a tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-018e081f-af08-4920-9d0b-3096441f6fa9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:53 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" returned: 0 in 0.486s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:53 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2 Apr 02 19:59:53 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:54 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" returned: 0 in 0.456s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-quobyte-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2" released by "delete_volume" :: held 0.982s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "cinder-0c7f239d-fe67-4413-a5ca-0260f53a1992-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-0c7f239d-fe67-4413-a5ca-0260f53a1992-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Created reservations ['acb7e1dd-a8b6-4714-a257-90b993f92b19', 'b8f0588e-8d21-46d2-9b3e-c1b3fe0b8e9e', '23d82b3a-5c9c-4a7a-9997-e03498247620', '35d287a2-d72c-49ad-a709-f9db84fed32d'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "cinder-quobyte-0c7f239d-fe67-4413-a5ca-0260f53a1992" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-quobyte-0c7f239d-fe67-4413-a5ca-0260f53a1992" acquired by "delete_volume" :: waited 0.026s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec96db-f575-4382-bfbe-ac2d14279773]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:54 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:54 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:54 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 Apr 02 19:59:54 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:54 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.381s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Deleted volume successfully. Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-97c56993-551f-4f18-9cbe-568300a6746f tempest-ServersNegativeTestJSON-2076719180 None] Lock "cinder-6bf1b8ba-5ae4-4d6c-aa6d-2711a3da5bc2-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:54 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992" returned: 0 in 0.483s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:54 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992 Apr 02 19:59:54 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:55 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0c7f239d-fe67-4413-a5ca-0260f53a1992" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-quobyte-0c7f239d-fe67-4413-a5ca-0260f53a1992" released by "delete_volume" :: held 0.916s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Created reservations ['37b45f87-54a3-41f8-8199-3251da8130a7', '80e932c9-f1f0-4750-974a-413f8b769aab', '833c1018-6b12-4976-a0ca-c80cba74538d', '4a92f239-b347-461e-9a0e-36a75eb7b1d9'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:55 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:55 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Flow 'volume_create_manager' (0b73a757-bf2f-46fe-a5d5-4b0c17ba2407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf608e-470a-446b-983d-a03db97e35ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf608e-470a-446b-983d-a03db97e35ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-13935185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67b27dc-d847-4e42-be7b-ab5b21a74c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f2cf4aeba64b448cf4fa69a013f13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:56Z,use_quota=True,user_id='e229a9ac4853405c98b3d5c13ff7458d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f844324e-47e2-447d-9cab-9216857ced97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f844324e-47e2-447d-9cab-9216857ced97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40ea85d-a626-46d1-a60c-ebc69135d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40ea85d-a626-46d1-a60c-ebc69135d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67b27dc-d847-4e42-be7b-ab5b21a74c30', 'volume_name': 'volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb9d1db-0473-40e5-8d8d-74d9bbea1161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb9d1db-0473-40e5-8d8d-74d9bbea1161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4693c2-52d9-4809-b50c-4b1e4ecd09dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:55 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Volume e67b27dc-d847-4e42-be7b-ab5b21a74c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30', 'volume_size': 1} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T17:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-13935185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67b27dc-d847-4e42-be7b-ab5b21a74c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f2cf4aeba64b448cf4fa69a013f13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T17:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T17:59:56Z,use_quota=True,user_id='e229a9ac4853405c98b3d5c13ff7458d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Creating volume e67b27dc-d847-4e42-be7b-ab5b21a74c30 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 19:59:55 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:55 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 1073741824 Apr 02 19:59:55 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:55 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Deleted volume successfully. Apr 02 19:59:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-95f5913d-3795-4bf2-a71e-357401a4465f tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-0c7f239d-fe67-4413-a5ca-0260f53a1992-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:56 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 1073741824" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:56 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 Apr 02 19:59:56 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:56 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4693c2-52d9-4809-b50c-4b1e4ecd09dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68eb556e-9390-4edf-8110-d9b3fd54319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 19:59:56 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Volume volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 (e67b27dc-d847-4e42-be7b-ab5b21a74c30): created successfully Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68eb556e-9390-4edf-8110-d9b3fd54319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 19:59:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Flow 'volume_create_manager' (0b73a757-bf2f-46fe-a5d5-4b0c17ba2407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 19:59:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fb62fdee-8aa6-4497-ac74-4815be9ca632 tempest-VolumesTransfersV357Test-598885002 None] Created volume successfully. Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "cinder-e67b27dc-d847-4e42-be7b-ab5b21a74c30-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-e67b27dc-d847-4e42-be7b-ab5b21a74c30-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "cinder-quobyte-e67b27dc-d847-4e42-be7b-ab5b21a74c30" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-quobyte-e67b27dc-d847-4e42-be7b-ab5b21a74c30" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d22b16-d072-4488-bc4f-091d07462b31]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:58 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 Apr 02 19:59:58 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:58 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:58 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30 Apr 02 19:59:58 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:59 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e67b27dc-d847-4e42-be7b-ab5b21a74c30" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-quobyte-e67b27dc-d847-4e42-be7b-ab5b21a74c30" released by "delete_volume" :: held 0.949s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Created reservations ['ef348e36-b6a7-4c67-aafb-f7ff6f90eae5', 'f01b20f8-c122-48da-a076-3a22eb78cd0b', '82af53bd-ad26-446d-b0f9-2a33bcf8dde3', '3b24bc25-6b71-4089-be29-ff33cee95803'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 19:59:59 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 19:59:59 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 19:59:59 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.406s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 19:59:59 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Deleted volume successfully. Apr 02 19:59:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-089ac9db-2b80-451d-b5c0-1e999ef3dca5 tempest-VolumesTransfersV357Test-1065310563 None] Lock "cinder-e67b27dc-d847-4e42-be7b-ab5b21a74c30-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Flow 'volume_create_manager' (594d2977-fa7f-4eb9-b3cb-11ff831e31d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39399695-b142-4cf2-81de-401abc149b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39399695-b142-4cf2-81de-401abc149b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1036065969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428ce71-cc3b-41ff-8d73-54d1367880cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e87026d6dfc497bb3cf9e693d459381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:02Z,use_quota=True,user_id='fde676bfc9ee419eb5aaf2ffa08ddd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76580ba7-d1d8-402b-a463-62dc3f780657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76580ba7-d1d8-402b-a463-62dc3f780657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff1adbc-49a6-4dd4-aa3f-a4385074db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff1adbc-49a6-4dd4-aa3f-a4385074db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b428ce71-cc3b-41ff-8d73-54d1367880cd', 'volume_name': 'volume-b428ce71-cc3b-41ff-8d73-54d1367880cd', 'volume_size': 2}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ea6c71-7736-4d1c-b778-386fc733397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ea6c71-7736-4d1c-b778-386fc733397b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f637f98-8a7a-4797-a5b3-15c736a57c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:02 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Volume b428ce71-cc3b-41ff-8d73-54d1367880cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b428ce71-cc3b-41ff-8d73-54d1367880cd', 'volume_size': 2} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1036065969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428ce71-cc3b-41ff-8d73-54d1367880cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e87026d6dfc497bb3cf9e693d459381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:02Z,use_quota=True,user_id='fde676bfc9ee419eb5aaf2ffa08ddd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Creating volume b428ce71-cc3b-41ff-8d73-54d1367880cd {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:02 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd 2147483648 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:02 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd 2147483648 Apr 02 20:00:02 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:03 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd 2147483648" returned: 0 in 0.503s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:03 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd Apr 02 20:00:03 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:03 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f637f98-8a7a-4797-a5b3-15c736a57c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b428ce71-cc3b-41ff-8d73-54d1367880cd', 'volume_size': 2}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c1c792-1c71-4169-9c13-95aa25c04ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:03 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Volume volume-b428ce71-cc3b-41ff-8d73-54d1367880cd (b428ce71-cc3b-41ff-8d73-54d1367880cd): created successfully Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c1c792-1c71-4169-9c13-95aa25c04ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Flow 'volume_create_manager' (594d2977-fa7f-4eb9-b3cb-11ff831e31d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-13dd2ff8-5765-40c4-846f-8bffdd532919 tempest-VolumesCloneNegativeTest-1572461410 None] Created volume successfully. Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Acquiring lock "cinder-b428ce71-cc3b-41ff-8d73-54d1367880cd-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "cinder-b428ce71-cc3b-41ff-8d73-54d1367880cd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Acquiring lock "cinder-quobyte-b428ce71-cc3b-41ff-8d73-54d1367880cd" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "cinder-quobyte-b428ce71-cc3b-41ff-8d73-54d1367880cd" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cce93b-a785-409b-857b-52a9166acee9]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:04 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd Apr 02 20:00:04 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:05 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd" returned: 0 in 0.512s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:05 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd Apr 02 20:00:05 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:05 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-b428ce71-cc3b-41ff-8d73-54d1367880cd" returned: 0 in 0.439s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "cinder-quobyte-b428ce71-cc3b-41ff-8d73-54d1367880cd" released by "delete_volume" :: held 0.983s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Created reservations ['dbf3c6e1-03e2-4bbd-9d8a-8bd71b0fcd2c', '50d2b96f-5962-4074-bcaf-36e6209674ea', '98d1e034-17c7-4083-ba15-fbfb35cf5eed', 'd360ce0c-83a6-4989-ad35-54ac6deff150'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:05 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:05 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:06 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Deleted volume successfully. Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e1d16f49-7731-48ed-b83a-6e31fe25ebb3 tempest-VolumesCloneNegativeTest-1572461410 None] Lock "cinder-b428ce71-cc3b-41ff-8d73-54d1367880cd-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:06 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:06 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:07 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (33041a0c-39c2-46ae-83d5-66e6cdf581c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc3c7df-2644-4359-8536-e6a5bdb89ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc3c7df-2644-4359-8536-e6a5bdb89ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-230826408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528b7b3-205b-4d46-8633-0a94fff48f87,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:09Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bb4c1-383e-422d-9aab-c6b9bf96461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bb4c1-383e-422d-9aab-c6b9bf96461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251b732e-f330-4c6f-976c-681e298fb71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251b732e-f330-4c6f-976c-681e298fb71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5528b7b3-205b-4d46-8633-0a94fff48f87', 'volume_name': 'volume-5528b7b3-205b-4d46-8633-0a94fff48f87', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace41978-b737-430b-9a05-76033dfeb03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace41978-b737-430b-9a05-76033dfeb03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd8d485-f3df-4bc7-aa73-524af4bf955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Volume 5528b7b3-205b-4d46-8633-0a94fff48f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5528b7b3-205b-4d46-8633-0a94fff48f87', 'volume_size': 1} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-230826408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528b7b3-205b-4d46-8633-0a94fff48f87,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:09Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Creating volume 5528b7b3-205b-4d46-8633-0a94fff48f87 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:09 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:09 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 1073741824 Apr 02 20:00:09 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9785f301-708b-475c-96eb-c423bd7480de tempest-GroupSnapshotsV319Test-786843203 None] Group tempest-GroupSnapshotsV319Test-Group-38657044: creating Apr 02 20:00:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9785f301-708b-475c-96eb-c423bd7480de tempest-GroupSnapshotsV319Test-786843203 None] Group tempest-GroupSnapshotsV319Test-Group-38657044: created successfully Apr 02 20:00:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9785f301-708b-475c-96eb-c423bd7480de tempest-GroupSnapshotsV319Test-786843203 None] Create group completed successfully. Apr 02 20:00:09 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 1073741824" returned: 0 in 0.517s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:09 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 Apr 02 20:00:09 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:10 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd8d485-f3df-4bc7-aa73-524af4bf955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5528b7b3-205b-4d46-8633-0a94fff48f87', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18811bbe-4322-44c7-880a-5017468c1951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Volume volume-5528b7b3-205b-4d46-8633-0a94fff48f87 (5528b7b3-205b-4d46-8633-0a94fff48f87): created successfully Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18811bbe-4322-44c7-880a-5017468c1951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (33041a0c-39c2-46ae-83d5-66e6cdf581c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:10 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d0df0b93-0e83-49a4-b9b7-dc100ff77812 tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Flow 'volume_create_manager' (ff29e8ae-71ed-4af9-8a64-ce8e8e3aa021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba03c4b4-9bd6-41d7-afd1-6a651ba1fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba03c4b4-9bd6-41d7-afd1-6a651ba1fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1096087816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bab3498c-587f-44f8-9d30-6e161400b291,host='devstack@QuobyteHD#QuobyteHD',id=ac082a6c-d8b3-42cb-abde-f7cc85cea48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92426c541e7349b6ab3ec088234e59ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:11Z,use_quota=True,user_id='7043cb9004a14b1f8a417fd2eb2c4628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(770f5c79-7770-4c75-8861-45baa234ad49),volume_type_id=770f5c79-7770-4c75-8861-45baa234ad49)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935e597f-3a6e-4c07-b62d-8251be448307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935e597f-3a6e-4c07-b62d-8251be448307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60660d75-94b5-45a7-990a-01c19967d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60660d75-94b5-45a7-990a-01c19967d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac082a6c-d8b3-42cb-abde-f7cc85cea48e', 'volume_name': 'volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c07d9c-29b3-455e-86ea-669518dfa862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c07d9c-29b3-455e-86ea-669518dfa862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea7ff38-5207-420c-b228-877201dff300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Volume ac082a6c-d8b3-42cb-abde-f7cc85cea48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e', 'volume_size': 1} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bab3498c-587f-44f8-9d30-6e161400b291,created_at=2026-04-02T18:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1096087816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bab3498c-587f-44f8-9d30-6e161400b291,host='devstack@QuobyteHD#QuobyteHD',id=ac082a6c-d8b3-42cb-abde-f7cc85cea48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92426c541e7349b6ab3ec088234e59ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:11Z,use_quota=True,user_id='7043cb9004a14b1f8a417fd2eb2c4628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(770f5c79-7770-4c75-8861-45baa234ad49),volume_type_id=770f5c79-7770-4c75-8861-45baa234ad49)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Creating volume ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:10 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:10 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e 1073741824 Apr 02 20:00:10 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:11 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e 1073741824" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:11 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e Apr 02 20:00:11 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (fbd67dbd-c94a-4f19-9bba-687e954a1577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b601804-f2ae-48b8-a412-82688ce0f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b601804-f2ae-48b8-a412-82688ce0f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-484414538',display_name='tempest-VolumesGetTest-Volume-407787491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0825bd49-7384-4c46-8541-3fc6258fac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:12Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21de559d-4aaa-4167-aead-2109e8628d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21de559d-4aaa-4167-aead-2109e8628d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2195c3-14ab-487f-871e-dc7d970176b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2195c3-14ab-487f-871e-dc7d970176b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0825bd49-7384-4c46-8541-3fc6258fac55', 'volume_name': 'volume-0825bd49-7384-4c46-8541-3fc6258fac55', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac37c9-f8c5-46de-ac2d-73763457e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ac37c9-f8c5-46de-ac2d-73763457e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffb647-82e2-438c-b150-eed54cefbbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Volume 0825bd49-7384-4c46-8541-3fc6258fac55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0825bd49-7384-4c46-8541-3fc6258fac55', 'volume_size': 1} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:11 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" returned: 0 in 0.402s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-484414538',display_name='tempest-VolumesGetTest-Volume-407787491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0825bd49-7384-4c46-8541-3fc6258fac55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:12Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Creating volume 0825bd49-7384-4c46-8541-3fc6258fac55 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:11 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea7ff38-5207-420c-b228-877201dff300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 1073741824 Apr 02 20:00:11 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd52f38b-6476-4ae4-b27e-fe6c84981738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Volume volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e (ac082a6c-d8b3-42cb-abde-f7cc85cea48e): created successfully Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd52f38b-6476-4ae4-b27e-fe6c84981738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Flow 'volume_create_manager' (ff29e8ae-71ed-4af9-8a64-ce8e8e3aa021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9f5d5693-d044-4214-82df-49a937b78cc7 tempest-GroupSnapshotsV319Test-786843203 None] Created volume successfully. Apr 02 20:00:12 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 1073741824" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:12 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 Apr 02 20:00:12 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:12 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55" returned: 0 in 0.395s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffb647-82e2-438c-b150-eed54cefbbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0825bd49-7384-4c46-8541-3fc6258fac55', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a19b9-f8db-4609-a53d-4566050ae359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:12 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Volume volume-0825bd49-7384-4c46-8541-3fc6258fac55 (0825bd49-7384-4c46-8541-3fc6258fac55): created successfully Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a19b9-f8db-4609-a53d-4566050ae359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (fbd67dbd-c94a-4f19-9bba-687e954a1577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-83bf14d3-2220-494a-a28e-1fa6db49cf1d tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] GroupSnapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: creating. Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Group snapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: creating. {{(pid=82597) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Creating offline snapshot e2139a23-1ba4-4675-9258-65536ca54642 of volume ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d94755-ceb1-443f-98df-b213f2672f18]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:13 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e Apr 02 20:00:13 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:13 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:13 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 1G Apr 02 20:00:13 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-0825bd49-7384-4c46-8541-3fc6258fac55-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "cinder-0825bd49-7384-4c46-8541-3fc6258fac55-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-0825bd49-7384-4c46-8541-3fc6258fac55" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-0825bd49-7384-4c46-8541-3fc6258fac55" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe92a2-f198-411e-a23e-390535bce933]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:13 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 Apr 02 20:00:13 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:14 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 1G" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:14 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 Apr 02 20:00:14 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:14 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55" returned: 0 in 0.495s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:14 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55 Apr 02 20:00:14 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:14 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:14 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:14 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 Apr 02 20:00:14 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:14 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0825bd49-7384-4c46-8541-3fc6258fac55" returned: 0 in 0.394s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-0825bd49-7384-4c46-8541-3fc6258fac55" released by "delete_volume" :: held 0.914s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Created reservations ['3c8d7276-9c43-4219-8b18-46bde13a3518', 'efea79d6-fbff-4343-9614-89908ebf35de', 'c7c99453-c241-4e0d-bcb6-b45b2904f3c8', 'f7838ac9-73ee-4c3e-b3f9-8921dd34666d'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:14 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642" returned: 0 in 0.384s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:14 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info Apr 02 20:00:14 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:14 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:14 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-5528b7b3-205b-4d46-8633-0a94fff48f87-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "cinder-5528b7b3-205b-4d46-8633-0a94fff48f87-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-5528b7b3-205b-4d46-8633-0a94fff48f87" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-5528b7b3-205b-4d46-8633-0a94fff48f87" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1cd7f-99d9-43d0-9e26-da585fa3d8ff]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:15 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 Apr 02 20:00:15 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:15 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:15 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:15 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:15 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info Apr 02 20:00:15 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-13e7ad21-219f-4233-8208-f00bb2ba9208 tempest-VolumesGetTest-1038239480 None] Lock "cinder-0825bd49-7384-4c46-8541-3fc6258fac55-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:15 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:15 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87 Apr 02 20:00:15 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:15 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.info" returned: 0 in 0.389s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:DELETE=7,cinder:SELECT=112,cinder:UPDATE=129,cinder:INSERT=37 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=163,cinder:SELECT=110,cinder:DELETE=18,cinder:INSERT=34 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:00:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e856fdfc-0cbf-4592-b978-d8997dff833e tempest-GroupSnapshotsV319Test-786843203 None] group_snapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: created successfully Apr 02 20:00:15 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5528b7b3-205b-4d46-8633-0a94fff48f87" returned: 0 in 0.393s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-5528b7b3-205b-4d46-8633-0a94fff48f87" released by "delete_volume" :: held 0.884s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:15 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Created reservations ['8a1fc40a-2043-4769-a090-3c18a78f54fd', 'c7bdce00-ca04-40e6-9aac-06cf0546504b', '45bb32f2-ba0b-42b9-8f17-5c0de741eae8', 'f81cceea-8751-480d-93cb-1f7dc28c6afa'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:16 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:16 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (390e4994-53b1-4966-bfb1-c251998ca017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd994d-7a2f-47fc-9e36-b0c0310f7dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd994d-7a2f-47fc-9e36-b0c0310f7dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459324945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb3ee69-3964-4207-8e2f-474ab1391d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:16Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e970dc28-3f01-4308-83e3-6ce62e586cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e970dc28-3f01-4308-83e3-6ce62e586cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b744fc0f-a921-4c3e-96b4-88f17ad24be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b744fc0f-a921-4c3e-96b4-88f17ad24be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb3ee69-3964-4207-8e2f-474ab1391d72', 'volume_name': 'volume-cbb3ee69-3964-4207-8e2f-474ab1391d72', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:16 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ee216-81e6-4c9d-a10b-6a3176c7b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321ee216-81e6-4c9d-a10b-6a3176c7b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2a45d7-19a3-463a-aa34-e8ca47d5cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:16 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Volume cbb3ee69-3964-4207-8e2f-474ab1391d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb3ee69-3964-4207-8e2f-474ab1391d72', 'volume_size': 1} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1459324945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb3ee69-3964-4207-8e2f-474ab1391d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:16Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Creating volume cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:16 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] group_snapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: deleting Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.490s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:16 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 1073741824 Apr 02 20:00:16 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] group_snapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: deleting {{(pid=82597) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-baddda38-2c84-4546-a8e2-b3ae43a52d51 tempest-VolumesGetTest-1038239480 None] Lock "cinder-5528b7b3-205b-4d46-8633-0a94fff48f87-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "cinder-quobyte-e2139a23-1ba4-4675-9258-65536ca54642" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-e2139a23-1ba4-4675-9258-65536ca54642" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Deleting offline snapshot e2139a23-1ba4-4675-9258-65536ca54642 of volume ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] snapshot_file for this snap is: volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e10f85-fd7c-4080-9570-79db291a6ed2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:16 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 Apr 02 20:00:16 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:16 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 1073741824" returned: 0 in 0.497s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:17 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:17 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:17 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d5b69-4baf-4457-a5b6-6e300859072a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:17 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e Apr 02 20:00:17 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:17 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.418s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2a45d7-19a3-463a-aa34-e8ca47d5cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb3ee69-3964-4207-8e2f-474ab1391d72', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f35438-a21a-42e7-bde7-8115a0075567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:17 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Volume volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 (cbb3ee69-3964-4207-8e2f-474ab1391d72): created successfully Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f35438-a21a-42e7-bde7-8115a0075567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (390e4994-53b1-4966-bfb1-c251998ca017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-47f3d20d-c8b6-4e49-8367-a0d6ad00d1d9 tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:17 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" returned: 0 in 0.498s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:17 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 Apr 02 20:00:17 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:18 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:18 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642 Apr 02 20:00:18 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:18 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e.e2139a23-1ba4-4675-9258-65536ca54642" returned: 0 in 0.391s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-e2139a23-1ba4-4675-9258-65536ca54642" released by "_delete_snapshot" :: held 1.874s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" released by "delete_snapshot" :: held 1.886s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:18 devstack cinder-volume[82597]: WARNING cinder.quota [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-219182209 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-219182209, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:00:18 devstack cinder-volume[82597]: WARNING cinder.quota [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-219182209 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-219182209, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] Created reservations ['481aceaa-ac5a-4c29-8b5e-27ebade0ae25', '54448576-2e3a-4886-a074-133345542479', '69604e86-5b97-4e1d-bdae-0b7736060b16', '2501cd0e-da59-4d7c-84e7-bf78d5bfdb65'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:18 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-92b0d442-70e6-467f-ac49-9d9873518cf5 tempest-GroupSnapshotsV319Test-786843203 None] group_snapshot 1ef2bfe6-d2b8-47c7-8bd2-05af201a187a: deleted successfully Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (9c48adc1-d5cb-4aa2-9653-d009550efd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2554593a-a269-4639-8703-07a28fc907f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2554593a-a269-4639-8703-07a28fc907f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-266750979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a2bf21-d1fc-463d-a796-8befb493bc5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cbb3ee69-3964-4207-8e2f-474ab1391d72,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:19Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395fee-7426-4a18-9e98-0de5d0dbfd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca395fee-7426-4a18-9e98-0de5d0dbfd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d3f3ad-4e03-4a7a-b09a-ac39b13e38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d3f3ad-4e03-4a7a-b09a-ac39b13e38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3a2bf21-d1fc-463d-a796-8befb493bc5a', 'volume_name': 'volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a', 'volume_size': 1, 'source_volid': 'cbb3ee69-3964-4207-8e2f-474ab1391d72', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cba1d0b-6bde-44e0-b051-9a7b2327c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cba1d0b-6bde-44e0-b051-9a7b2327c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca396eb4-aea6-4157-bb63-2e5a26d38446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:18 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Volume a3a2bf21-d1fc-463d-a796-8befb493bc5a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a', 'volume_size': 1, 'source_volid': 'cbb3ee69-3964-4207-8e2f-474ab1391d72', 'source_volstatus': 'available'} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:18 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Cloning volume cbb3ee69-3964-4207-8e2f-474ab1391d72 to volume a3a2bf21-d1fc-463d-a796-8befb493bc5a Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Creating offline snapshot b7771eb0-8f72-4005-a8f8-68479a3431ca of volume cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" acquired by "delete_volume" :: waited 0.021s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[85469c4a-8052-4a83-baf5-3da86e6117f4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee0b2c-7c28-458c-a463-fdb31e0118c0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:18 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:18 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:18 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e Apr 02 20:00:18 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:19 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.463s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:19 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" returned: 0 in 0.471s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:19 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca 1G Apr 02 20:00:19 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:19 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e Apr 02 20:00:19 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:19 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" returned: 0 in 0.421s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Lock "cinder-quobyte-ac082a6c-d8b3-42cb-abde-f7cc85cea48e" released by "delete_volume" :: held 0.929s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:19 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca 1G" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:19 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:19 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Created reservations ['6a41d080-7182-422f-b377-265c18534d57'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:19 devstack cinder-volume[82597]: WARNING cinder.quota [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-219182209 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-219182209, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Created reservations ['551fbfc6-0cab-407c-a11d-11995c45f7d0', '49fda374-4422-44a9-bf7a-be0082218d99', 'ac5c7784-3e69-4902-928c-8252993b48aa', '85aa0409-c7fc-4c6e-b5d3-6a4be92e4f3e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:19 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:19 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:20 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.423s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:20 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca is being set with open permissions: ugo+rw Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:20 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:20 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:20 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-58702200-fcba-41bd-a6f1-64819b00ce78 tempest-GroupSnapshotsV319Test-786843203 None] Delete group completed successfully. Apr 02 20:00:20 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.401s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:20 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info Apr 02 20:00:20 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:21 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:21 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info is being set with open permissions: ugo+rw Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:21 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info Apr 02 20:00:21 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:21 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.info" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] snapshot: b7771eb0-8f72-4005-a8f8-68479a3431ca, volume: a3a2bf21-d1fc-463d-a796-8befb493bc5a, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d029574-1284-46ed-8f43-e8075f2d06ee]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:21 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:21 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:22 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.536s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb3ee69-3964-4207-8e2f-474ab1391d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d805ec63-10be-4422-b854-71a3a04691c8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:22 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:22 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:22 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:00:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:22 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a Apr 02 20:00:22 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:24 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a" returned: 0 in 2.290s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e936dad9-4da4-450c-80ce-f8fe41ed017a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:25 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:25 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:25 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.613s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:25 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:00:25 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Converted 1024.00 MB image at 446.93 MB/s Apr 02 20:00:25 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a is being set with open permissions: ugo+rw Apr 02 20:00:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:25 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a Apr 02 20:00:25 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:25 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a" returned: 0 in 0.443s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" released by "_copy_volume_from_snapshot" :: held 4.485s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-b7771eb0-8f72-4005-a8f8-68479a3431ca" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-b7771eb0-8f72-4005-a8f8-68479a3431ca" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Deleting offline snapshot b7771eb0-8f72-4005-a8f8-68479a3431ca of volume cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] snapshot_file for this snap is: volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8283d3-baab-4fde-81e2-14ec7f9087c8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:26 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:26 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:26 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.497s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbb3ee69-3964-4207-8e2f-474ab1391d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59f4fcb-b3bf-4c8d-b21f-d83535075490]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:26 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:26 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:27 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:27 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:27 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:27 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.493s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:27 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca Apr 02 20:00:27 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:27 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72.b7771eb0-8f72-4005-a8f8-68479a3431ca" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-b7771eb0-8f72-4005-a8f8-68479a3431ca" released by "_delete_snapshot" :: held 1.988s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.172s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca396eb4-aea6-4157-bb63-2e5a26d38446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a', 'volume_size': 1, 'source_volid': 'cbb3ee69-3964-4207-8e2f-474ab1391d72', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30555f6e-1061-4c79-942b-00ea97da2707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Volume volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a (a3a2bf21-d1fc-463d-a796-8befb493bc5a): created successfully Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30555f6e-1061-4c79-942b-00ea97da2707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (9c48adc1-d5cb-4aa2-9653-d009550efd78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ffbd7daa-5cf2-4bcf-b6ed-3d678694c65c tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0f75f12f-0fbe-4625-b38c-5b70bd30fc8f tempest-GroupsV314Test-1505726783 None] Group tempest-GroupsV314Test-Group-1308146123: creating Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0f75f12f-0fbe-4625-b38c-5b70bd30fc8f tempest-GroupsV314Test-1505726783 None] Group tempest-GroupsV314Test-Group-1308146123: created successfully Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0f75f12f-0fbe-4625-b38c-5b70bd30fc8f tempest-GroupsV314Test-1505726783 None] Create group completed successfully. Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (c677abc4-3bc1-4246-be1d-e282251f0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24f9b9-61c5-4c98-af09-af8a8d8e61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef24f9b9-61c5-4c98-af09-af8a8d8e61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1781129178',display_name='tempest-VolumesGetTest-Volume-479481751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab80e32-3272-49a1-9cdd-5a3d3f532a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:29Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a14ad0-cbb1-4dd0-b50b-abf164a8a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a14ad0-cbb1-4dd0-b50b-abf164a8a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45773ec0-e05c-497e-b0dd-7982729ec04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45773ec0-e05c-497e-b0dd-7982729ec04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab80e32-3272-49a1-9cdd-5a3d3f532a42', 'volume_name': 'volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736f010-0585-4f2f-a84a-873d9f23a67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736f010-0585-4f2f-a84a-873d9f23a67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8b7b11-274b-4989-98db-006ba47adf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Volume 6ab80e32-3272-49a1-9cdd-5a3d3f532a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42', 'volume_size': 1} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1781129178',display_name='tempest-VolumesGetTest-Volume-479481751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab80e32-3272-49a1-9cdd-5a3d3f532a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:29Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Creating volume 6ab80e32-3272-49a1-9cdd-5a3d3f532a42 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:28 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:28 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 1073741824 Apr 02 20:00:28 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:29 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 1073741824" returned: 0 in 0.505s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:29 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 Apr 02 20:00:29 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Flow 'volume_create_manager' (b7106eb3-ed47-44d2-ba1c-b519640a496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c59416-1f94-4ab9-8793-85cad81fdcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c59416-1f94-4ab9-8793-85cad81fdcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1915446431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6c24a7d-a71d-4c98-a38a-bb7679513387,host='devstack@QuobyteHD#QuobyteHD',id=71d4a31e-179a-42a2-8a4d-a37416213ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc5bb34950c469db8bcd0615fef9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:29Z,use_quota=True,user_id='9e0d79c0e1fc4e87a72f215ded03dc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72ac1884-d4de-4003-afbf-97c704121f00),volume_type_id=72ac1884-d4de-4003-afbf-97c704121f00)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ba2f73-ec1c-4555-ad67-e4feef22d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ba2f73-ec1c-4555-ad67-e4feef22d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dd5088-36c1-48ce-9e2f-8ac2621e1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dd5088-36c1-48ce-9e2f-8ac2621e1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d4a31e-179a-42a2-8a4d-a37416213ac5', 'volume_name': 'volume-71d4a31e-179a-42a2-8a4d-a37416213ac5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307cc3ab-8c29-4876-a5f2-cb6ab8a6282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307cc3ab-8c29-4876-a5f2-cb6ab8a6282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f68f14-5206-42ae-b7eb-8ea18367c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Volume 71d4a31e-179a-42a2-8a4d-a37416213ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d4a31e-179a-42a2-8a4d-a37416213ac5', 'volume_size': 1} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:29 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c6c24a7d-a71d-4c98-a38a-bb7679513387,created_at=2026-04-02T18:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1915446431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c6c24a7d-a71d-4c98-a38a-bb7679513387,host='devstack@QuobyteHD#QuobyteHD',id=71d4a31e-179a-42a2-8a4d-a37416213ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc5bb34950c469db8bcd0615fef9532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:29Z,use_quota=True,user_id='9e0d79c0e1fc4e87a72f215ded03dc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72ac1884-d4de-4003-afbf-97c704121f00),volume_type_id=72ac1884-d4de-4003-afbf-97c704121f00)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Creating volume 71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:29 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:29 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 1073741824 Apr 02 20:00:29 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8b7b11-274b-4989-98db-006ba47adf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f5fba0-4c30-4eba-afcb-2f6a3b25fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:29 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Volume volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 (6ab80e32-3272-49a1-9cdd-5a3d3f532a42): created successfully Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f5fba0-4c30-4eba-afcb-2f6a3b25fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (c677abc4-3bc1-4246-be1d-e282251f0381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-93acaebd-3717-4a3f-924c-c2968075468f tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:30 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 1073741824" returned: 0 in 0.465s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:30 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:30 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:30 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.391s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f68f14-5206-42ae-b7eb-8ea18367c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d4a31e-179a-42a2-8a4d-a37416213ac5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3fc1fb-dcf2-4802-9d19-31c6df468dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:30 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Volume volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 (71d4a31e-179a-42a2-8a4d-a37416213ac5): created successfully Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3fc1fb-dcf2-4802-9d19-31c6df468dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Flow 'volume_create_manager' (b7106eb3-ed47-44d2-ba1c-b519640a496b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2abeb632-cbe5-454d-b8d0-baf3557b80be tempest-GroupsV314Test-1505726783 None] Created volume successfully. Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-6ab80e32-3272-49a1-9cdd-5a3d3f532a42-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "cinder-6ab80e32-3272-49a1-9cdd-5a3d3f532a42-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c9b5b-2bde-4cf9-be48-86603b949a60]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:31 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 Apr 02 20:00:31 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:31 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:31 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42 Apr 02 20:00:31 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:31 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" returned: 0 in 0.393s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-6ab80e32-3272-49a1-9cdd-5a3d3f532a42" released by "delete_volume" :: held 0.872s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:31 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Created reservations ['aa083d28-c012-4fe6-bb30-cb5848d3742f', '44425cb9-1138-40f4-a0db-c9b9bea32400', '85888d56-36a2-4ec4-901f-dbdf7fef95da', '558dfdc9-dda6-4fdb-be5b-09ed5481c1c2'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:32 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:32 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-a3a2bf21-d1fc-463d-a796-8befb493bc5a-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "cinder-a3a2bf21-d1fc-463d-a796-8befb493bc5a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8841f2-a5cf-4728-bb9a-2489f05ef55b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:32 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a Apr 02 20:00:32 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:32 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Cloning volume 71d4a31e-179a-42a2-8a4d-a37416213ac5 to volume 898f6b54-f47b-4479-8bca-f9f83d1fa1f0 Apr 02 20:00:32 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Creating offline snapshot b543ea52-3b42-4e05-9dac-55c466285912 of volume 71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:00:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f5483-5531-4969-b3d1-3239ee2d982d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ddbdfbe2-3a7b-4e7c-878e-c52d97e300cd tempest-VolumesGetTest-1038239480 None] Lock "cinder-6ab80e32-3272-49a1-9cdd-5a3d3f532a42-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:32 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:32 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:32 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:32 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a Apr 02 20:00:32 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:32 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.460s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:32 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 1G Apr 02 20:00:32 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:33 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3a2bf21-d1fc-463d-a796-8befb493bc5a" returned: 0 in 0.399s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-a3a2bf21-d1fc-463d-a796-8befb493bc5a" released by "delete_volume" :: held 0.921s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Created reservations ['6de8f7c9-4b77-4b78-bf43-bcf57e9d17b0', 'ba996758-0604-404b-bfde-c049fc18cf59', '71430699-da0c-4a1a-b49d-66f5dca2115f', 'e91cba5e-32bd-4539-80f2-e5f852e84cd3'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:33 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:33 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-cbb3ee69-3964-4207-8e2f-474ab1391d72-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "cinder-cbb3ee69-3964-4207-8e2f-474ab1391d72-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-cbb3ee69-3964-4207-8e2f-474ab1391d72" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-cbb3ee69-3964-4207-8e2f-474ab1391d72" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb46e0b-1b0f-48c2-8a29-0effedfaee13]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:33 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 1G" returned: 0 in 0.526s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:33 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:33 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:33 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:33 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:33 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-41dfeae1-2856-4af9-868a-7c65b225cdda tempest-VolumesGetTest-1038239480 None] Lock "cinder-a3a2bf21-d1fc-463d-a796-8befb493bc5a-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:33 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.428s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:33 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:33 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:33 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:33 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:33 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72 Apr 02 20:00:33 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:34 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:34 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cbb3ee69-3964-4207-8e2f-474ab1391d72" returned: 0 in 0.384s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-cbb3ee69-3964-4207-8e2f-474ab1391d72" released by "delete_volume" :: held 0.901s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:34 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info Apr 02 20:00:34 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Created reservations ['02c69864-ca50-42ec-9946-55db4a3c0533', '9a55e27f-991b-4e1b-a7c3-66eebc247faa', '97998da4-7db5-4388-9374-62d6407f25df', 'ff18a15d-162a-4dfd-a787-8e8be33e5d77'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:34 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:34 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:34 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:34 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:34 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info Apr 02 20:00:34 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:34 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (f632aa65-371e-46dc-a3c0-aaef3472683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7096a44b-c54a-473b-b345-d01ca6c2a45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:34 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7096a44b-c54a-473b-b345-d01ca6c2a45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-631739470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ead4bad-50b0-4c76-9756-01731c4afb21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:35Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c015a15f-dc58-41ea-bcbf-2161786fc8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c015a15f-dc58-41ea-bcbf-2161786fc8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e58fb7-5416-4ce6-86a9-606728f666bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.image.glance [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Creating Keystone auth plugin from conf {{(pid=82597) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-23924eb8-515b-49cc-9749-a1561c85af0f tempest-VolumesGetTest-1038239480 None] Lock "cinder-cbb3ee69-3964-4207-8e2f-474ab1391d72-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e58fb7-5416-4ce6-86a9-606728f666bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ead4bad-50b0-4c76-9756-01731c4afb21', 'volume_name': 'volume-1ead4bad-50b0-4c76-9756-01731c4afb21', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa48422-7e42-4c7d-bd88-533d5c02e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa48422-7e42-4c7d-bd88-533d5c02e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3888ca6-45f8-4643-9638-bfa1673cbd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:35 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Volume 1ead4bad-50b0-4c76-9756-01731c4afb21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ead4bad-50b0-4c76-9756-01731c4afb21', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Trying to clone 1ead4bad-50b0-4c76-9756-01731c4afb21 from image 9973ca61-39fa-459d-874e-a0e627b97de3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]). {{(pid=82597) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 20:00:35 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.info" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Acquiring lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] snapshot: b543ea52-3b42-4e05-9dac-55c466285912, volume: 898f6b54-f47b-4479-8bca-f9f83d1fa1f0, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdeee56-da1d-4406-8fe1-c336060b0522]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:35 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:35 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 20:00:35 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Image download 20.69 MB at 20.69 MB/s Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f04982-038d-41ad-9f32-70954f767b23]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:35 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD Apr 02 20:00:35 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:35 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71d4a31e-179a-42a2-8a4d-a37416213ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c00f8-8d98-494d-a071-c2a5407a834f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:35 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:35 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:35 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 is fetched for user 097fe7363d084a2ea6b159fe079316d4. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[39950ef6-be1f-4673-bfda-597191e8b26d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:36 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD Apr 02 20:00:36 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:36 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.463s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:36 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:00:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:36 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 Apr 02 20:00:36 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:36 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:38 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" returned: 0 in 1.948s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0d54d-791e-4dc6-a9c5-f79a1130bb50]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:38 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:38 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:38 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.584s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:00:38 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Converted 1024.00 MB image at 525.35 MB/s Apr 02 20:00:38 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 20:00:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:38 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 Apr 02 20:00:38 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:39 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" returned: 0 in 0.399s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" released by "_copy_volume_from_snapshot" :: held 3.936s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Acquiring lock "cinder-quobyte-b543ea52-3b42-4e05-9dac-55c466285912" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-b543ea52-3b42-4e05-9dac-55c466285912" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Deleting offline snapshot b543ea52-3b42-4e05-9dac-55c466285912 of volume 71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] snapshot_file for this snap is: volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b2fc8-d3f1-4e9e-91ee-8b091f4a3876]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:39 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:39 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:39 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71d4a31e-179a-42a2-8a4d-a37416213ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b2f08-ab63-435c-88db-eddbf1382866]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:39 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:39 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:40 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:40 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:40 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:40 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.448s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:40 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912 Apr 02 20:00:40 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:41 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5.b543ea52-3b42-4e05-9dac-55c466285912" returned: 0 in 0.380s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-b543ea52-3b42-4e05-9dac-55c466285912" released by "_delete_snapshot" :: held 1.821s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.591s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.583s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-631739470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ead4bad-50b0-4c76-9756-01731c4afb21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:35Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Creating volume 1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:41 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:41 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1073741824 Apr 02 20:00:41 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1b79a41d-e4ac-4289-a133-69c838094e23 tempest-GroupsV314Test-1505726783 None] Create group from source-group-c6c24a7d-a71d-4c98-a38a-bb7679513387 completed successfully. Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Acquiring lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0be7bd-4cf5-44eb-9f39-997ed441ca2c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:41 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 Apr 02 20:00:41 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:41 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1073741824" returned: 0 in 0.512s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:41 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:41 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:41 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:41 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0 Apr 02 20:00:41 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:41 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Attempting download of 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume 1ead4bad-50b0-4c76-9756-01731c4afb21. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a611375-a67b-4997-a3aa-b48bd01529e7]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:42 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v Apr 02 20:00:42 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:42 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-898f6b54-f47b-4479-8bca-f9f83d1fa1f0" released by "delete_volume" :: held 0.948s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Created reservations ['ce97ac7d-bf99-452e-afc0-b66c7a45c104'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:42 devstack cinder-volume[82597]: WARNING cinder.quota [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1489941062 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1489941062, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:00:42 devstack cinder-volume[82597]: WARNING cinder.quota [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1489941062 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1489941062, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Created reservations ['184c1b3c-7cf2-4193-8722-309df58680c6', 'ecb642fa-2b48-44c3-bb8f-96ad3313799b', '5fe1ed67-0e76-4398-b55c-b50cf3a900a8', 'cf014157-b91a-4660-b06f-42469d980463'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:42 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:42 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:42 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:42 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v Apr 02 20:00:42 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:42 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3a970465-1392-4851-ab5c-83c5f61aa028 tempest-GroupsV314Test-1505726783 None] Delete group completed successfully. Apr 02 20:00:42 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v" returned: 1 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9973ca61-39fa-459d-874e-a0e627b97de3_vjn_p00v' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705acb5-2efe-41e0-a038-e8d0ec997aa2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:43 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD Apr 02 20:00:43 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:43 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] 9973ca61-39fa-459d-874e-a0e627b97de3 was qcow2, converting to raw {{(pid=82597) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:43 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:43 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Acquiring lock "cinder-quobyte-71d4a31e-179a-42a2-8a4d-a37416213ac5" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-71d4a31e-179a-42a2-8a4d-a37416213ac5" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1e8f9-d492-4a01-a8ae-cfce66f125f8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:43 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:43 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:44 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 0 in 0.834s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9973ca61-39fa-459d-874e-a0e627b97de3_ayr6xy4adevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:00:44 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Converted 112.00 MB image at 112.00 MB/s Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:44 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1G Apr 02 20:00:44 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:44 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.557s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:44 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5 Apr 02 20:00:44 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:44 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 1G" returned: 0 in 0.420s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:44 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-71d4a31e-179a-42a2-8a4d-a37416213ac5" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Lock "cinder-quobyte-71d4a31e-179a-42a2-8a4d-a37416213ac5" released by "delete_volume" :: held 0.989s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33dabf3-d565-4641-bd6d-ebd3ed0b2e92]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Created reservations ['1f4f573f-c188-4f75-b865-445f734a3294'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:44 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:44 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Created reservations ['fa9ba4c6-b061-442b-a16a-2ad715da2526', '7e7d4f4b-436b-4d7b-88bc-eead0f2cc63b', '0998b31c-7eea-4421-bb1c-accfb0f5d85f', 'b1de28fe-e4e4-4132-8b1b-57c23e49b6ad'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:44 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:44 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:45 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 0 in 0.482s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:45 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.404s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-542e592e-cf6f-4665-a81f-399ddfc566e4 tempest-GroupsV314Test-1505726783 None] Delete group completed successfully. Apr 02 20:00:45 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:45 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:45 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 1 in 0.459s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Downloaded image 9973ca61-39fa-459d-874e-a0e627b97de3 ((None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}])) to volume 1ead4bad-50b0-4c76-9756-01731c4afb21 successfully. {{(pid=82597) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Temporary image 9973ca61-39fa-459d-874e-a0e627b97de3 for user 097fe7363d084a2ea6b159fe079316d4 is deleted. {{(pid=82597) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.volume_utils [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Marking volume 1ead4bad-50b0-4c76-9756-01731c4afb21 as bootable. {{(pid=82597) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Copying metadata from image 9973ca61-39fa-459d-874e-a0e627b97de3 to 1ead4bad-50b0-4c76-9756-01731c4afb21. {{(pid=82597) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Creating volume glance metadata for volume 1ead4bad-50b0-4c76-9756-01731c4afb21 backed by image 9973ca61-39fa-459d-874e-a0e627b97de3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82597) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3888ca6-45f8-4643-9638-bfa1673cbd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ead4bad-50b0-4c76-9756-01731c4afb21', 'volume_size': 1, 'image_id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9973ca61-39fa-459d-874e-a0e627b97de3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eaaa46225cd5471ea52504787fd71c47', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9973ca61-39fa-459d-874e-a0e627b97de3', 'created_at': datetime.datetime(2026, 4, 2, 17, 49, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 17, 49, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9973ca61-39fa-459d-874e-a0e627b97de3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11737d15-0153-4e5b-bc33-752b287ccb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:45 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Volume volume-1ead4bad-50b0-4c76-9756-01731c4afb21 (1ead4bad-50b0-4c76-9756-01731c4afb21): created successfully Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11737d15-0153-4e5b-bc33-752b287ccb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (f632aa65-371e-46dc-a3c0-aaef3472683d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6991e5f8-c5c2-4ec8-938b-eb8f78b607ba tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (6acca228-fbd0-41f4-b125-aa67bfbe27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67641a6-5f85-4f4e-a73a-18cbb9be8fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67641a6-5f85-4f4e-a73a-18cbb9be8fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1608620760',display_name='tempest-VolumesGetTest-Volume-2049916362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e45361-1c26-49e1-b664-f9b72acb7a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:47Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9a8807-f66d-4755-8c87-7bee54a61dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9a8807-f66d-4755-8c87-7bee54a61dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39e71ab-1503-4c07-b9a9-80f062843123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39e71ab-1503-4c07-b9a9-80f062843123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e45361-1c26-49e1-b664-f9b72acb7a5f', 'volume_name': 'volume-73e45361-1c26-49e1-b664-f9b72acb7a5f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca619ba1-53a0-45f1-8b87-a854ee4d3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca619ba1-53a0-45f1-8b87-a854ee4d3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b40971-f6bd-418b-b8a5-9918e4ae6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:47 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Volume 73e45361-1c26-49e1-b664-f9b72acb7a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e45361-1c26-49e1-b664-f9b72acb7a5f', 'volume_size': 1} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1608620760',display_name='tempest-VolumesGetTest-Volume-2049916362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e45361-1c26-49e1-b664-f9b72acb7a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1dcccd851254645a7e0a5ea10964736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:47Z,use_quota=True,user_id='097fe7363d084a2ea6b159fe079316d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Creating volume 73e45361-1c26-49e1-b664-f9b72acb7a5f {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:47 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:47 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f 1073741824 Apr 02 20:00:47 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:47 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f 1073741824" returned: 0 in 0.549s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:47 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f Apr 02 20:00:47 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:48 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f" returned: 0 in 0.428s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b40971-f6bd-418b-b8a5-9918e4ae6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e45361-1c26-49e1-b664-f9b72acb7a5f', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84742253-eb6a-45f7-a0a1-5e53afd0a617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:48 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Volume volume-73e45361-1c26-49e1-b664-f9b72acb7a5f (73e45361-1c26-49e1-b664-f9b72acb7a5f): created successfully Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84742253-eb6a-45f7-a0a1-5e53afd0a617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Flow 'volume_create_manager' (6acca228-fbd0-41f4-b125-aa67bfbe27fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a2be1c07-a2e9-4c15-9a82-a40cb04b2101 tempest-VolumesGetTest-1038239480 None] Created volume successfully. Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-73e45361-1c26-49e1-b664-f9b72acb7a5f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "cinder-73e45361-1c26-49e1-b664-f9b72acb7a5f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-73e45361-1c26-49e1-b664-f9b72acb7a5f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-73e45361-1c26-49e1-b664-f9b72acb7a5f" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[416763e6-62b6-4f60-b367-518e8944ac3b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:49 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f Apr 02 20:00:49 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:49 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:49 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f Apr 02 20:00:49 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:50 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-73e45361-1c26-49e1-b664-f9b72acb7a5f" returned: 0 in 0.453s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-73e45361-1c26-49e1-b664-f9b72acb7a5f" released by "delete_volume" :: held 0.993s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Created reservations ['af47bc48-d324-44df-ad2f-699109806817', '3740a0c6-1a38-4fc6-83c5-6fd009662e0e', '4967abf4-34b7-4084-b7ca-c1d1ad5fcb65', 'a65e4fd0-7082-45fd-b612-6e5bf95f9bbf'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:50 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:50 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:50 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.432s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c61668c7-9298-4665-9d8f-db28fd53303f tempest-VolumesGetTest-1038239480 None] Lock "cinder-73e45361-1c26-49e1-b664-f9b72acb7a5f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-1ead4bad-50b0-4c76-9756-01731c4afb21-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "cinder-1ead4bad-50b0-4c76-9756-01731c4afb21-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Acquiring lock "cinder-quobyte-1ead4bad-50b0-4c76-9756-01731c4afb21" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-1ead4bad-50b0-4c76-9756-01731c4afb21" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf57f9d3-15ec-45e8-822d-a482db14084c]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:51 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:51 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:52 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 0 in 0.520s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:52 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:52 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:52 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 1 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:52 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21 Apr 02 20:00:52 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Flow 'volume_create_manager' (c82d60ff-5bfe-4825-96be-d6bb32c53d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d622510-a0c2-470a-9dc3-3aa546b6ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d622510-a0c2-470a-9dc3-3aa546b6ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-18589568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37788b8a-9a37-4efd-b556-0093d5987978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfaaa2e6c08b4ef0a03140a7f9e61324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:53Z,use_quota=True,user_id='a2c6ace0bd52413caf2a060f398e6cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6834d461-4bcf-43fd-a570-0dd79163bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6834d461-4bcf-43fd-a570-0dd79163bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54853a2b-adb3-453e-8aa5-1114ee851e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54853a2b-adb3-453e-8aa5-1114ee851e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37788b8a-9a37-4efd-b556-0093d5987978', 'volume_name': 'volume-37788b8a-9a37-4efd-b556-0093d5987978', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c5dec0-298a-43ed-bc60-f12dc9ac1a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c5dec0-298a-43ed-bc60-f12dc9ac1a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c28a22-2395-4053-9af9-08d5d959e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:52 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume 37788b8a-9a37-4efd-b556-0093d5987978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37788b8a-9a37-4efd-b556-0093d5987978', 'volume_size': 1} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-18589568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37788b8a-9a37-4efd-b556-0093d5987978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfaaa2e6c08b4ef0a03140a7f9e61324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:53Z,use_quota=True,user_id='a2c6ace0bd52413caf2a060f398e6cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Creating volume 37788b8a-9a37-4efd-b556-0093d5987978 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:53 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:53 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 1073741824 Apr 02 20:00:53 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:53 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1ead4bad-50b0-4c76-9756-01731c4afb21" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "cinder-quobyte-1ead4bad-50b0-4c76-9756-01731c4afb21" released by "delete_volume" :: held 1.485s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Created reservations ['5ba4de63-361b-4abc-ad89-2b2191895608', '45a0911e-438f-4016-bff1-6ea8de370786', 'b6108ee7-ab03-4f2e-8c48-9bd21206c801', 'd6345f3c-2e70-4930-9429-b44af528c75c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:53 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:53 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:53 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 1073741824" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:53 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 Apr 02 20:00:53 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:53 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.406s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Deleted volume successfully. Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f52f8ca1-7ebd-4a66-afee-a955700eb9bb tempest-VolumesGetTest-1038239480 None] Lock "cinder-1ead4bad-50b0-4c76-9756-01731c4afb21-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:53 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978" returned: 0 in 0.429s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c28a22-2395-4053-9af9-08d5d959e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37788b8a-9a37-4efd-b556-0093d5987978', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e020a5-02f7-4b74-a140-fc18e2f0eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:53 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume volume-37788b8a-9a37-4efd-b556-0093d5987978 (37788b8a-9a37-4efd-b556-0093d5987978): created successfully Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e020a5-02f7-4b74-a140-fc18e2f0eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:53 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Flow 'volume_create_manager' (c82d60ff-5bfe-4825-96be-d6bb32c53d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2b6d450b-b4f3-4cf9-be75-4e21aaae2f45 tempest-VolumeQuotasAdminTestJSON-523523409 None] Created volume successfully. Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "cinder-37788b8a-9a37-4efd-b556-0093d5987978-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "cinder-37788b8a-9a37-4efd-b556-0093d5987978-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "cinder-quobyte-37788b8a-9a37-4efd-b556-0093d5987978" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "cinder-quobyte-37788b8a-9a37-4efd-b556-0093d5987978" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[35268baf-a243-49f6-bb3f-a71637192509]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:54 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 Apr 02 20:00:54 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:54 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978" returned: 0 in 0.467s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:54 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978 Apr 02 20:00:54 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:55 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-37788b8a-9a37-4efd-b556-0093d5987978" returned: 0 in 0.411s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "cinder-quobyte-37788b8a-9a37-4efd-b556-0093d5987978" released by "delete_volume" :: held 0.902s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Created reservations ['c12bde1d-6553-4c47-939f-1615c572c1f5', 'cf8f33de-5170-465f-8ad8-c3eda64fbb36', '87367608-175d-491a-a263-e0a134fced88', 'e55615d9-fea9-4969-9a52-7d012ca6cdac'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:55 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:55 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Flow 'volume_create_manager' (c8cdbd9f-e0e1-463b-9767-62f84152a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bbeda0-2208-419b-bd9d-6871f96c677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bbeda0-2208-419b-bd9d-6871f96c677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036241564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070364d8-fa89-43ee-805d-71cc57169983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfaaa2e6c08b4ef0a03140a7f9e61324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:55Z,use_quota=True,user_id='a2c6ace0bd52413caf2a060f398e6cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a904e2e7-15c5-4343-aa6b-37dd0f35bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a904e2e7-15c5-4343-aa6b-37dd0f35bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051dec61-9038-4e8e-b61e-3e4ddb2dcf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051dec61-9038-4e8e-b61e-3e4ddb2dcf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070364d8-fa89-43ee-805d-71cc57169983', 'volume_name': 'volume-070364d8-fa89-43ee-805d-71cc57169983', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d07b707-f89f-4e75-b971-0d3c8792901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d07b707-f89f-4e75-b971-0d3c8792901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac5a74b-3f6a-445a-a29e-438cf44c5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:55 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume 070364d8-fa89-43ee-805d-71cc57169983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070364d8-fa89-43ee-805d-71cc57169983', 'volume_size': 1} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2036241564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070364d8-fa89-43ee-805d-71cc57169983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfaaa2e6c08b4ef0a03140a7f9e61324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:55Z,use_quota=True,user_id='a2c6ace0bd52413caf2a060f398e6cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Creating volume 070364d8-fa89-43ee-805d-71cc57169983 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:55 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:55 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 1073741824 Apr 02 20:00:55 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:55 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:00:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Deleted volume successfully. Apr 02 20:00:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-4fa666ba-503d-4c06-9169-d139d723ff83 tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "cinder-37788b8a-9a37-4efd-b556-0093d5987978-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:56 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 1073741824" returned: 0 in 0.554s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:56 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 Apr 02 20:00:56 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:56 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983" returned: 0 in 0.436s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac5a74b-3f6a-445a-a29e-438cf44c5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070364d8-fa89-43ee-805d-71cc57169983', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae189fe1-acb2-4855-9829-df0856f02626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Volume volume-070364d8-fa89-43ee-805d-71cc57169983 (070364d8-fa89-43ee-805d-71cc57169983): created successfully Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae189fe1-acb2-4855-9829-df0856f02626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Flow 'volume_create_manager' (c8cdbd9f-e0e1-463b-9767-62f84152a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-661c969e-f385-4cc6-97c1-61af632c2fda tempest-VolumeQuotasAdminTestJSON-523523409 None] Created volume successfully. Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (013e413e-16d1-45b4-841d-989492b64a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6072d96c-4415-4921-ba2c-3c2b98593836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6072d96c-4415-4921-ba2c-3c2b98593836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549785894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:57Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d8e665-1e3d-4dc6-9cad-b85396da4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d8e665-1e3d-4dc6-9cad-b85396da4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af350d27-c304-4a66-96ea-9eba78cce990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af350d27-c304-4a66-96ea-9eba78cce990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757', 'volume_name': 'volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d8fa49-8198-4d9e-b371-d324bd410207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d8fa49-8198-4d9e-b371-d324bd410207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c861b2c-032c-49ae-8956-bb1c2b376472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:56 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Volume 2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757', 'volume_size': 1} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-549785894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:00:57Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Creating volume 2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:00:56 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:00:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:56 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 1073741824 Apr 02 20:00:56 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:57 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 1073741824" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:57 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:00:57 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:57 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.398s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c861b2c-032c-49ae-8956-bb1c2b376472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b5a725-801e-452c-ba5d-5fd370d8d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:00:57 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Volume volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 (2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757): created successfully Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b5a725-801e-452c-ba5d-5fd370d8d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:00:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (013e413e-16d1-45b4-841d-989492b64a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:00:57 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-dcd64728-4198-486d-9196-33e67cb1b4b1 tempest-VolumeDependencyTests-1666058164 None] Created volume successfully. Apr 02 20:00:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-6a0be8be-a8bd-4740-bfba-0dd4d44d18c4 tempest-VolumeQuotasAdminTestJSON-1609928277 None] Transfer volume completed successfully. Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Acquiring lock "cinder-070364d8-fa89-43ee-805d-71cc57169983-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "cinder-070364d8-fa89-43ee-805d-71cc57169983-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Acquiring lock "cinder-quobyte-070364d8-fa89-43ee-805d-71cc57169983" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "cinder-quobyte-070364d8-fa89-43ee-805d-71cc57169983" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca15df6-9cb9-4506-81cd-f33539dedf19]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:58 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 Apr 02 20:00:58 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Creating offline snapshot 9c9be32a-70d2-475d-800e-bc08b2bb420d of volume 2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c86f4a-71fa-43a7-9562-e8759b9e5546]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:59 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:00:59 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:59 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983" returned: 0 in 0.513s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:59 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983 Apr 02 20:00:59 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:59 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.459s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:59 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d 1G Apr 02 20:00:59 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:00:59 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-070364d8-fa89-43ee-805d-71cc57169983" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "cinder-quobyte-070364d8-fa89-43ee-805d-71cc57169983" released by "delete_volume" :: held 0.927s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Created reservations ['42c69f2c-8874-4c5a-9e30-08423e74ac19', '0a2ba269-ee06-447f-a13f-996bfbe5131e', 'a99ebe1d-41fc-41a2-9d92-589771674e5f', '0d7cb712-d0f7-4ae8-99eb-b5083a54d516'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:00:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:00:59 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:00:59 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:00 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d 1G" returned: 0 in 0.529s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:00 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:00 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:00 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Deleted volume successfully. Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-0ed53a45-5ef0-47b4-a22e-9d568c65433d tempest-VolumeQuotasAdminTestJSON-1025063254 None] Lock "cinder-070364d8-fa89-43ee-805d-71cc57169983-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:00 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:00 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d is being set with open permissions: ugo+rw Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:00 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:00 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:00 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.416s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:00 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info Apr 02 20:01:00 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:01 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:01 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info is being set with open permissions: ugo+rw Apr 02 20:01:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:01 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info Apr 02 20:01:01 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:01 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.info" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c089e967-6de6-4cba-b87e-6bc65b582ed2 tempest-VolumeDependencyTests-1666058164 None] Create snapshot completed successfully Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (8fea303a-b1fc-4807-af7a-6044686a4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d491a26a-ec87-40e5-ad67-41eb75bf5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d491a26a-ec87-40e5-ad67-41eb75bf5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-266042508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af6ff19-6966-4701-8a06-a6b1d021edbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c9be32a-70d2-475d-800e-bc08b2bb420d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:02Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dabe4b-01d8-47f8-9c8e-eeb8c1861269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dabe4b-01d8-47f8-9c8e-eeb8c1861269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9292c281-015b-4c6d-acaf-aee38ea6d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9292c281-015b-4c6d-acaf-aee38ea6d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1af6ff19-6966-4701-8a06-a6b1d021edbe', 'volume_name': 'volume-1af6ff19-6966-4701-8a06-a6b1d021edbe', 'volume_size': 1, 'snapshot_id': '9c9be32a-70d2-475d-800e-bc08b2bb420d'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6f706c-b1b6-43aa-9d80-18ef2c75dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6f706c-b1b6-43aa-9d80-18ef2c75dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc59901-53a3-4c7d-bec1-9c3740eb0f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:02 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Volume 1af6ff19-6966-4701-8a06-a6b1d021edbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1af6ff19-6966-4701-8a06-a6b1d021edbe', 'volume_size': 1, 'snapshot_id': '9c9be32a-70d2-475d-800e-bc08b2bb420d'} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d-1af6ff19-6966-4701-8a06-a6b1d021edbe" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d-1af6ff19-6966-4701-8a06-a6b1d021edbe" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Creating volume 1af6ff19-6966-4701-8a06-a6b1d021edbe from snapshot 9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] snapshot: 9c9be32a-70d2-475d-800e-bc08b2bb420d, volume: 1af6ff19-6966-4701-8a06-a6b1d021edbe, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[20994e65-568f-4818-9adb-5ce4261892bf]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:02 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:02 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:03 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6addf-8ce2-42d3-aa2a-982c6cee891b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:03 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:01:03 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:03 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:03 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe Apr 02 20:01:03 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Flow 'volume_create_manager' (ef277e1e-c467-415b-b6fe-6375682a49f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d0782-e409-46ed-b8ed-ed4a01e8bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d0782-e409-46ed-b8ed-ed4a01e8bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1501843861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc24189-76b0-420a-897e-92b885fa0241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9998bb19d69c4489bbadc797e9c1c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:04Z,use_quota=True,user_id='6c8b1855b71a4bba8b48702b7894d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59bd9f4b-5f46-401d-9e61-e25d6e0f8fa8),volume_type_id=59bd9f4b-5f46-401d-9e61-e25d6e0f8fa8)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0184885c-69d3-431e-83ab-38832cdbaf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0184885c-69d3-431e-83ab-38832cdbaf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463b07e1-0d17-4bc8-a7dd-956d2631376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463b07e1-0d17-4bc8-a7dd-956d2631376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc24189-76b0-420a-897e-92b885fa0241', 'volume_name': 'volume-0bc24189-76b0-420a-897e-92b885fa0241', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53d193-d189-4652-9909-bbc7e033057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53d193-d189-4652-9909-bbc7e033057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c22afdf-8f8a-40c2-8b0f-881e67f115aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:03 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Volume 0bc24189-76b0-420a-897e-92b885fa0241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc24189-76b0-420a-897e-92b885fa0241', 'volume_size': 1} Apr 02 20:01:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:05 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe" returned: 0 in 2.036s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:05 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc0bdcc-2cfb-4bb3-adb2-ef5433965a3d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:05 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:01:05 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:06 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.558s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:01:06 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Converted 1024.00 MB image at 502.78 MB/s Apr 02 20:01:06 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe is being set with open permissions: ugo+rw Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:06 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe Apr 02 20:01:06 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:06 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe" returned: 0 in 0.382s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" released by "_copy_volume_from_snapshot" :: held 4.032s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d-1af6ff19-6966-4701-8a06-a6b1d021edbe" released by "_create_volume_from_snapshot" :: held 4.048s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.055s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.731s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1501843861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc24189-76b0-420a-897e-92b885fa0241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9998bb19d69c4489bbadc797e9c1c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:04Z,use_quota=True,user_id='6c8b1855b71a4bba8b48702b7894d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59bd9f4b-5f46-401d-9e61-e25d6e0f8fa8),volume_type_id=59bd9f4b-5f46-401d-9e61-e25d6e0f8fa8)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Creating volume 0bc24189-76b0-420a-897e-92b885fa0241 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:06 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:06 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 1073741824 Apr 02 20:01:06 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc59901-53a3-4c7d-bec1-9c3740eb0f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af6ff19-6966-4701-8a06-a6b1d021edbe', 'volume_size': 1, 'snapshot_id': '9c9be32a-70d2-475d-800e-bc08b2bb420d'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c947ca6-4b6d-4ccf-bbdd-2e6185772fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:06 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Volume volume-1af6ff19-6966-4701-8a06-a6b1d021edbe (1af6ff19-6966-4701-8a06-a6b1d021edbe): created successfully Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c947ca6-4b6d-4ccf-bbdd-2e6185772fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (8fea303a-b1fc-4807-af7a-6044686a4c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3c52e483-a96f-4a5e-81b3-93cbea3076b8 tempest-VolumeDependencyTests-1666058164 None] Created volume successfully. Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:06 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:06 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:07 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 1073741824" returned: 0 in 0.515s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:07 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.427s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:07 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 Apr 02 20:01:07 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:07 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c22afdf-8f8a-40c2-8b0f-881e67f115aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc24189-76b0-420a-897e-92b885fa0241', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1ccb2-f9ca-48d9-bca3-ae97251fc300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Volume volume-0bc24189-76b0-420a-897e-92b885fa0241 (0bc24189-76b0-420a-897e-92b885fa0241): created successfully Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1ccb2-f9ca-48d9-bca3-ae97251fc300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Flow 'volume_create_manager' (ef277e1e-c467-415b-b6fe-6375682a49f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:07 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-063ee062-17e8-482a-83e6-93752043b88e tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Created volume successfully. Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-9c9be32a-70d2-475d-800e-bc08b2bb420d-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-9c9be32a-70d2-475d-800e-bc08b2bb420d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Deleting offline snapshot 9c9be32a-70d2-475d-800e-bc08b2bb420d of volume 2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] snapshot_file for this snap is: volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ff4ae-6847-45a6-b449-2a27b96dbabb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:07 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:07 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:08 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.513s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:01:08 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:08 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d43eafe-d68e-463a-b54b-16ddcf893c9a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:08 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:01:08 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:08 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:08 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2e0d3fdc-3b93-4ac7-8f09-0802eb284d69 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Retype volume completed successfully. Apr 02 20:01:08 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:08 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:08 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:09 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.436s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:09 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d Apr 02 20:01:09 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "cinder-0bc24189-76b0-420a-897e-92b885fa0241-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "cinder-0bc24189-76b0-420a-897e-92b885fa0241-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "cinder-quobyte-0bc24189-76b0-420a-897e-92b885fa0241" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "cinder-quobyte-0bc24189-76b0-420a-897e-92b885fa0241" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd9f9f4-f8b5-4fb4-abc7-dab6161c229b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:09 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757.9c9be32a-70d2-475d-800e-bc08b2bb420d" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:09 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 Apr 02 20:01:09 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-9c9be32a-70d2-475d-800e-bc08b2bb420d" released by "_delete_snapshot" :: held 1.856s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" released by "delete_snapshot" :: held 1.867s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Created reservations ['c5bc3625-2536-4f56-b57f-c19ca064ec6b', 'e7c7ab9b-d5a8-44ff-8c1c-f0d16f1c2e41', '3f7d2b71-8fdd-4e64-87c0-44ef24d401e2', '6a1b01a3-f0af-4fd9-a161-c009456e3be4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Delete snapshot completed successfully. Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-75f94559-77fc-4c46-b35f-9f2a62030a7f tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-9c9be32a-70d2-475d-800e-bc08b2bb420d-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[397f448a-6edc-4c81-819c-03b31569f929]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:10 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:01:10 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:10 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:10 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241 Apr 02 20:01:10 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:10 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:10 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757 Apr 02 20:01:10 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:10 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0bc24189-76b0-420a-897e-92b885fa0241" returned: 0 in 0.391s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "cinder-quobyte-0bc24189-76b0-420a-897e-92b885fa0241" released by "delete_volume" :: held 0.913s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:10 devstack cinder-volume[82597]: WARNING cinder.quota [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:01:10 devstack cinder-volume[82597]: WARNING cinder.quota [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Created reservations ['0f68bddc-ee6e-4290-8590-4221bd646833', '44a217da-4f4c-48fe-a319-1de1bee5bbb7', '6aa268fc-6ff5-46a4-b7ed-e855c3c52431', '97d64902-15b3-417a-b0d1-5e77056f9e68'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:10 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:10 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:10 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757" released by "delete_volume" :: held 0.945s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Created reservations ['7f38f04a-0767-47da-90cf-dd0c3ce36b63', '65fdcece-4477-47d1-ad89-c21e45287279', '82b101a7-eb45-4766-bcbc-1e949a3f7feb', 'aa1b31f2-55ba-4da8-8d31-3908340cc999'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:11 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:11 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:11 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Deleted volume successfully. Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58e3cd3c-4846-4409-b5ac-5d856d421717 tempest-VolumeRetypeWithoutMigrationTest-218453082 None] Lock "cinder-0bc24189-76b0-420a-897e-92b885fa0241-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (33d3bdeb-479e-488e-8c12-638c93316a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91df35e9-65dc-4f1a-ba6a-2cc75eeeea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91df35e9-65dc-4f1a-ba6a-2cc75eeeea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1553274348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a094d3-12c6-4bbd-9e08-878649be1e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:11Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434962fe-7e1f-4203-b334-eb34759b2f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434962fe-7e1f-4203-b334-eb34759b2f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6287263-71a9-47ef-9525-3a943420f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6287263-71a9-47ef-9525-3a943420f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a094d3-12c6-4bbd-9e08-878649be1e14', 'volume_name': 'volume-29a094d3-12c6-4bbd-9e08-878649be1e14', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e84f8e2-f042-465e-a9b6-29f12c0c7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e84f8e2-f042-465e-a9b6-29f12c0c7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8956fdd-ef58-461a-b584-53ed50785a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Volume 29a094d3-12c6-4bbd-9e08-878649be1e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a094d3-12c6-4bbd-9e08-878649be1e14', 'volume_size': 1} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1553274348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a094d3-12c6-4bbd-9e08-878649be1e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:11Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Creating volume 29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:11 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:11 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 1073741824 Apr 02 20:01:11 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:11 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.530s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Deleted volume successfully. Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b04938ee-0473-41cc-b20c-9b5d4815809e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-2fac8f3f-e61e-41bd-85c5-bf7c6d6f8757-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:11 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 1073741824" returned: 0 in 0.535s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:11 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:11 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:12 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8956fdd-ef58-461a-b584-53ed50785a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a094d3-12c6-4bbd-9e08-878649be1e14', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45adc818-517a-401c-b3bb-70de1fe2bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:12 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Volume volume-29a094d3-12c6-4bbd-9e08-878649be1e14 (29a094d3-12c6-4bbd-9e08-878649be1e14): created successfully Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45adc818-517a-401c-b3bb-70de1fe2bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (33d3bdeb-479e-488e-8c12-638c93316a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f089d8d1-e472-4ea3-a7aa-bd23707d42de tempest-VolumeDependencyTests-1666058164 None] Created volume successfully. Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Flow 'volume_create_manager' (8b268f59-d850-42ec-ac91-9290f7781016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4657ffce-fc2d-4031-8716-48a4ed22d8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4657ffce-fc2d-4031-8716-48a4ed22d8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366232027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883f1714-d303-4532-b66b-5f2ca2b7b15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9824d29d9357463aa0224ace383b103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:13Z,use_quota=True,user_id='36d69239115a4de4a4b7baed11a07b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bcebb7-82aa-4198-9b56-f2ac99202269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bcebb7-82aa-4198-9b56-f2ac99202269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184fe566-2f3d-4220-bfb5-81204d2b7ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184fe566-2f3d-4220-bfb5-81204d2b7ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883f1714-d303-4532-b66b-5f2ca2b7b15d', 'volume_name': 'volume-883f1714-d303-4532-b66b-5f2ca2b7b15d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94728ce4-42ff-4593-be92-31455f1bcce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94728ce4-42ff-4593-be92-31455f1bcce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5709abf5-b9db-4422-adda-c9966cedfe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Volume 883f1714-d303-4532-b66b-5f2ca2b7b15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883f1714-d303-4532-b66b-5f2ca2b7b15d', 'volume_size': 1} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1366232027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883f1714-d303-4532-b66b-5f2ca2b7b15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9824d29d9357463aa0224ace383b103c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:13Z,use_quota=True,user_id='36d69239115a4de4a4b7baed11a07b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Creating volume 883f1714-d303-4532-b66b-5f2ca2b7b15d {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:13 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:13 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d 1073741824 Apr 02 20:01:13 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (8d27f49f-d0df-4835-a595-27b117a9c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7df543-1c2d-4479-a8bc-87ddd23e92a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7df543-1c2d-4479-a8bc-87ddd23e92a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72541689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f71ba5d-8f44-4b20-8202-6ccb4fc291bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0996f4d13d421cb5ca9c6dacec5573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=29a094d3-12c6-4bbd-9e08-878649be1e14,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:14Z,use_quota=True,user_id='cfffa9fb6d1f4b3881fa4256037fade6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979524bd-79a2-4eee-80b3-383fb249bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979524bd-79a2-4eee-80b3-383fb249bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154bc0ae-ca7f-4d8c-a8b4-3df0c89e0403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154bc0ae-ca7f-4d8c-a8b4-3df0c89e0403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f71ba5d-8f44-4b20-8202-6ccb4fc291bf', 'volume_name': 'volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf', 'volume_size': 1, 'source_volid': '29a094d3-12c6-4bbd-9e08-878649be1e14', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c550c3-f16d-447f-a8e9-842316d6345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c550c3-f16d-447f-a8e9-842316d6345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8c4d6a-f3f0-4d31-9154-59c4a69c67bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:13 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Volume 6f71ba5d-8f44-4b20-8202-6ccb4fc291bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf', 'volume_size': 1, 'source_volid': '29a094d3-12c6-4bbd-9e08-878649be1e14', 'source_volstatus': 'available'} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:13 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d 1073741824" returned: 0 in 0.476s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:13 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d Apr 02 20:01:13 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:14 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d" returned: 0 in 0.384s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.480s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Cloning volume 29a094d3-12c6-4bbd-9e08-878649be1e14 to volume 6f71ba5d-8f44-4b20-8202-6ccb4fc291bf Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5709abf5-b9db-4422-adda-c9966cedfe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883f1714-d303-4532-b66b-5f2ca2b7b15d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0809f7-0e5b-4c7c-87db-f4d08b23a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Volume volume-883f1714-d303-4532-b66b-5f2ca2b7b15d (883f1714-d303-4532-b66b-5f2ca2b7b15d): created successfully Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0809f7-0e5b-4c7c-87db-f4d08b23a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Flow 'volume_create_manager' (8b268f59-d850-42ec-ac91-9290f7781016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Creating offline snapshot 48b9806e-ab20-4352-ab39-986742d851b7 of volume 29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:01:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b70445ae-9bed-405a-8594-6a9d53e0b014 tempest-VolumesMetadataTest-1630009237 None] Created volume successfully. Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d071084-4cb6-4db1-9e6d-6cd2f95aaac4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:14 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:14 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:14 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.442s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:14 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 1G Apr 02 20:01:14 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:15 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 1G" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a094d3-12c6-4bbd-9e08-878649be1e14 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:15 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a094d3-12c6-4bbd-9e08-878649be1e14 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:15 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:15 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a094d3-12c6-4bbd-9e08-878649be1e14 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.504s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:15 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 is being set with open permissions: ugo+rw Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:15 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:15 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Acquiring lock "cinder-883f1714-d303-4532-b66b-5f2ca2b7b15d-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "cinder-883f1714-d303-4532-b66b-5f2ca2b7b15d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=150,cinder:INSERT=43,cinder:UPDATE=199,cinder:DELETE=8 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=153,cinder:UPDATE=155,cinder:INSERT=51,cinder:DELETE=16 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Acquiring lock "cinder-quobyte-883f1714-d303-4532-b66b-5f2ca2b7b15d" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "cinder-quobyte-883f1714-d303-4532-b66b-5f2ca2b7b15d" acquired by "delete_volume" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3022995-bbbf-479d-b234-83097a5e9af6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:16 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d Apr 02 20:01:16 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:16 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:16 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info Apr 02 20:01:16 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:16 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d" returned: 0 in 0.483s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:16 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d Apr 02 20:01:16 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:16 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info" returned: 0 in 0.394s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:16 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info is being set with open permissions: ugo+rw Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:16 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info Apr 02 20:01:16 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:16 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-883f1714-d303-4532-b66b-5f2ca2b7b15d" returned: 0 in 0.386s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "cinder-quobyte-883f1714-d303-4532-b66b-5f2ca2b7b15d" released by "delete_volume" :: held 0.893s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Created reservations ['baecf745-0d65-4ffc-ba87-be75f1ac085c', '99779a0f-7eff-434f-b2c2-5c6c9061f64a', '7992cbb5-2075-43f1-8055-60f85d92b8f6', '0cb9d96b-6bf7-4199-a5d8-60fb24f86fda'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:16 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.info" returned: 0 in 0.415s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:16 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:16 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] snapshot: 48b9806e-ab20-4352-ab39-986742d851b7, volume: 6f71ba5d-8f44-4b20-8202-6ccb4fc291bf, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7461e-5239-407a-a41d-fc1d1d5f6995]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:17 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:17 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:17 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Deleted volume successfully. Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1415bea4-b533-4970-9bbe-9262f1e448c5 tempest-VolumesMetadataTest-1630009237 None] Lock "cinder-883f1714-d303-4532-b66b-5f2ca2b7b15d-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:17 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.516s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a094d3-12c6-4bbd-9e08-878649be1e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319ed28-9112-4ce0-83ff-228cda5048a7]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:17 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:17 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:18 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:18 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:01:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:18 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf Apr 02 20:01:18 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:20 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" returned: 0 in 2.218s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2be7013-c2d4-458f-bb6b-394609cfa221]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:20 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:20 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Flow 'volume_create_manager' (b2517c49-4162-4617-b667-180cfebee1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f4f582-1b4a-4ce3-bcea-272590389ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f4f582-1b4a-4ce3-bcea-272590389ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-772887623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ac7598-1be8-4103-beed-5dbd4faee9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162025d3d92e465e88727274bbc3ca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:21Z,use_quota=True,user_id='bed8418039d04ea899d19b99249d2d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376cf63d-8166-4137-ae39-37fd405336f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376cf63d-8166-4137-ae39-37fd405336f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d6327b-8658-4fa1-9031-2e3fb1e8751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d6327b-8658-4fa1-9031-2e3fb1e8751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ac7598-1be8-4103-beed-5dbd4faee9df', 'volume_name': 'volume-a3ac7598-1be8-4103-beed-5dbd4faee9df', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941994b8-1b30-4c25-ac20-98286d2ae40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941994b8-1b30-4c25-ac20-98286d2ae40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c60825-fd8e-4ca4-ac76-36e5a85bdcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:20 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Volume a3ac7598-1be8-4103-beed-5dbd4faee9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ac7598-1be8-4103-beed-5dbd4faee9df', 'volume_size': 1} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:20 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.590s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:01:20 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Converted 1024.00 MB image at 461.42 MB/s Apr 02 20:01:20 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf is being set with open permissions: ugo+rw Apr 02 20:01:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:20 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf Apr 02 20:01:20 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:21 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" returned: 0 in 0.389s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" released by "_copy_volume_from_snapshot" :: held 4.272s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-48b9806e-ab20-4352-ab39-986742d851b7" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-48b9806e-ab20-4352-ab39-986742d851b7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Deleting offline snapshot 48b9806e-ab20-4352-ab39-986742d851b7 of volume 29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] snapshot_file for this snap is: volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e39cc-6eac-4656-8149-20da1b647329]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:21 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:21 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:21 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a094d3-12c6-4bbd-9e08-878649be1e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673917e-3ac6-42a5-8ac2-2940bca7cb25]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:21 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:21 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:22 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:22 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:22 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:22 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.432s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:22 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7 Apr 02 20:01:22 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:23 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14.48b9806e-ab20-4352-ab39-986742d851b7" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-48b9806e-ab20-4352-ab39-986742d851b7" released by "_delete_snapshot" :: held 1.798s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.882s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-772887623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ac7598-1be8-4103-beed-5dbd4faee9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162025d3d92e465e88727274bbc3ca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:21Z,use_quota=True,user_id='bed8418039d04ea899d19b99249d2d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Creating volume a3ac7598-1be8-4103-beed-5dbd4faee9df {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:23 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8c4d6a-f3f0-4d31-9154-59c4a69c67bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf', 'volume_size': 1, 'source_volid': '29a094d3-12c6-4bbd-9e08-878649be1e14', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:23 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df 1073741824 Apr 02 20:01:23 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfab66e-2f4b-43be-bc7a-010a8e003304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:23 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Volume volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf (6f71ba5d-8f44-4b20-8202-6ccb4fc291bf): created successfully Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfab66e-2f4b-43be-bc7a-010a8e003304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Flow 'volume_create_manager' (8d27f49f-d0df-4835-a595-27b117a9c888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-eaf5488a-90f9-4295-82ba-8e7c05b01bc4 tempest-VolumeDependencyTests-1666058164 None] Created volume successfully. Apr 02 20:01:23 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df 1073741824" returned: 0 in 0.457s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:23 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df Apr 02 20:01:23 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:23 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c60825-fd8e-4ca4-ac76-36e5a85bdcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ac7598-1be8-4103-beed-5dbd4faee9df', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d838169b-12fb-4cf5-8272-1d715ffd60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:24 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Volume volume-a3ac7598-1be8-4103-beed-5dbd4faee9df (a3ac7598-1be8-4103-beed-5dbd4faee9df): created successfully Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d838169b-12fb-4cf5-8272-1d715ffd60ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Flow 'volume_create_manager' (b2517c49-4162-4617-b667-180cfebee1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-278b6198-4d34-404f-9566-70af4e1e4326 tempest-VolumesTransfersTest-808209781 None] Created volume successfully. Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-29a094d3-12c6-4bbd-9e08-878649be1e14-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-29a094d3-12c6-4bbd-9e08-878649be1e14-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-29a094d3-12c6-4bbd-9e08-878649be1e14" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-29a094d3-12c6-4bbd-9e08-878649be1e14" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff3db9-c7f1-4308-9eec-dc3d8391427e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:24 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:24 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:24 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:24 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14 Apr 02 20:01:24 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:25 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-29a094d3-12c6-4bbd-9e08-878649be1e14" returned: 0 in 0.415s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-29a094d3-12c6-4bbd-9e08-878649be1e14" released by "delete_volume" :: held 0.908s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Created reservations ['6c5d69be-7f6f-4a3c-bde2-279b4ea4c37b', '0351a528-e860-4c19-ae67-887aa230941d', '3e62e54b-a1c9-406b-a585-5e90e9a9f801', '24a21f2d-d00a-472e-8512-b1fbf5e4f12c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:25 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:25 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-93fce98e-91b6-4fb4-811b-07f236b1b74d tempest-VolumesTransfersTest-982627200 None] Transfer volume completed successfully. Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbcc5ba-26d7-49b8-ab72-d1689ff562fb]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:25 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf Apr 02 20:01:25 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:25 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.418s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Deleted volume successfully. Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f6202912-dbf1-4b57-a842-8942e03c5627 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-29a094d3-12c6-4bbd-9e08-878649be1e14-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:25 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:25 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf Apr 02 20:01:25 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "cinder-a3ac7598-1be8-4103-beed-5dbd4faee9df-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-a3ac7598-1be8-4103-beed-5dbd4faee9df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "cinder-quobyte-a3ac7598-1be8-4103-beed-5dbd4faee9df" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-quobyte-a3ac7598-1be8-4103-beed-5dbd4faee9df" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06582d3-7123-4f3f-887f-6bf7afc6f8c7]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:26 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df Apr 02 20:01:26 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:26 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" returned: 0 in 0.439s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf" released by "delete_volume" :: held 0.958s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Created reservations ['4a51e120-9fd2-4042-88a2-340a4a59a830', '9783cc76-d781-417d-be80-d1cdbb27591d', '47c735a7-0dfb-4db4-a2b2-a73836eb91de', '8d984204-4f62-44ee-ad81-fe558bb3687a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:26 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:26 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-1af6ff19-6966-4701-8a06-a6b1d021edbe-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-1af6ff19-6966-4701-8a06-a6b1d021edbe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[032893be-95fc-4adc-9e84-93ac9b535e67]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:26 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe Apr 02 20:01:26 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:26 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:26 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df Apr 02 20:01:26 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:26 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:26 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Deleted volume successfully. Apr 02 20:01:26 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-27f00899-56f3-47da-9c26-e9a6f2ba5d0e tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-6f71ba5d-8f44-4b20-8202-6ccb4fc291bf-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:27 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:27 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-a3ac7598-1be8-4103-beed-5dbd4faee9df" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-quobyte-a3ac7598-1be8-4103-beed-5dbd4faee9df" released by "delete_volume" :: held 0.932s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:27 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe Apr 02 20:01:27 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Created reservations ['d788fcf6-c898-4d2a-873a-0ae4776e0fad', '13d8e5bf-31be-4725-8920-3d7c0133c6a0', 'ad7a4e14-a053-419a-8f86-3d53f6a11a81', '15e3c818-b694-46c4-9f4d-53f2ab831e54'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:27 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:27 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:27 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Flow 'volume_create_manager' (00d3ad58-8d09-4e28-bde2-af2873b7f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bc3840-1a50-45cf-ad06-1f1e24acf580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bc3840-1a50-45cf-ad06-1f1e24acf580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-4685165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da440f5a-0d4f-4a8a-abcd-fb0ba51af498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162025d3d92e465e88727274bbc3ca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:27Z,use_quota=True,user_id='bed8418039d04ea899d19b99249d2d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5006033-38e5-4510-83bd-904dc62a94fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5006033-38e5-4510-83bd-904dc62a94fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70c775-a36f-45e5-ab37-b56f879f31fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df70c775-a36f-45e5-ab37-b56f879f31fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da440f5a-0d4f-4a8a-abcd-fb0ba51af498', 'volume_name': 'volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e606f0-46e5-45e8-b780-336ccfdc2e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e606f0-46e5-45e8-b780-336ccfdc2e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beda8a4-0da0-4da6-9bae-75db2d26c0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:27 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Volume da440f5a-0d4f-4a8a-abcd-fb0ba51af498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498', 'volume_size': 1} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-4685165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da440f5a-0d4f-4a8a-abcd-fb0ba51af498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162025d3d92e465e88727274bbc3ca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:27Z,use_quota=True,user_id='bed8418039d04ea899d19b99249d2d5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Creating volume da440f5a-0d4f-4a8a-abcd-fb0ba51af498 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:27 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-1af6ff19-6966-4701-8a06-a6b1d021edbe" returned: 0 in 0.502s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-quobyte-1af6ff19-6966-4701-8a06-a6b1d021edbe" released by "delete_volume" :: held 1.017s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:27 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 1073741824 Apr 02 20:01:27 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Created reservations ['ffe62eb8-1a69-47e8-b646-b17745e02208', '234b3f19-cc87-4ea6-81dc-f489cf88079f', '76ab28b9-6390-42b0-b890-a0970296bf16', '031dd843-0f80-4c6c-bfd5-21e1a7d03d42'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:27 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.506s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:27 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:27 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:27 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Deleted volume successfully. Apr 02 20:01:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e13baa51-a65c-4d55-b12c-f685a6cf0eda tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-a3ac7598-1be8-4103-beed-5dbd4faee9df-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:28 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 1073741824" returned: 0 in 0.514s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:28 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.431s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Deleted volume successfully. Apr 02 20:01:28 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 Apr 02 20:01:28 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c484dede-79a8-4cb0-a7c1-7541d8ac38c3 tempest-VolumeDependencyTests-1666058164 None] Lock "cinder-1af6ff19-6966-4701-8a06-a6b1d021edbe-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:28 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" returned: 0 in 0.410s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beda8a4-0da0-4da6-9bae-75db2d26c0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d8a7ca-b27f-4b87-acda-73a1efe6411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:28 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Volume volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 (da440f5a-0d4f-4a8a-abcd-fb0ba51af498): created successfully Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d8a7ca-b27f-4b87-acda-73a1efe6411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:28 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Flow 'volume_create_manager' (00d3ad58-8d09-4e28-bde2-af2873b7f86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c9c1b296-c56e-45cd-be1b-a62d86c4bde0 tempest-VolumesTransfersTest-808209781 None] Created volume successfully. Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "cinder-da440f5a-0d4f-4a8a-abcd-fb0ba51af498-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-da440f5a-0d4f-4a8a-abcd-fb0ba51af498-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "cinder-quobyte-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-quobyte-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a3aa40-028d-4e89-ad89-1e840048bf92]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:01:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:29 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 Apr 02 20:01:29 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:30 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:30 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498 Apr 02 20:01:30 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:30 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-quobyte-da440f5a-0d4f-4a8a-abcd-fb0ba51af498" released by "delete_volume" :: held 0.912s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Created reservations ['68838a63-6f55-481b-a398-3b06fd4978ab', '421d5d3c-5095-45c1-b358-0fbcb76cd223', '00e3e00c-0394-4f39-b430-715e287f729f', 'c93ea04e-c5f4-4163-a7a5-e002c4e4b1b4'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:30 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:01:30 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:31 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:31 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:01:31 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Deleted volume successfully. Apr 02 20:01:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e6f1e630-770c-421f-8770-f20373d64773 tempest-VolumesTransfersTest-1149666652 None] Lock "cinder-da440f5a-0d4f-4a8a-abcd-fb0ba51af498-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Flow 'volume_create_manager' (a7b2ec31-d146-466e-ba43-f0256872f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c75b07a-e36d-4621-9649-02e0ccda0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c75b07a-e36d-4621-9649-02e0ccda0513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1380094684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821dac3f-2bc2-4191-9c72-6f8cde304ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6067784cf554e67afbeaa09eb9ba077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:39Z,use_quota=True,user_id='6db7bb0c56aa400d913be323465a0f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3138e3-ffb1-46b9-9c68-c4288805da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3138e3-ffb1-46b9-9c68-c4288805da53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0865368-53de-4351-9630-c4a1e07ea960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0865368-53de-4351-9630-c4a1e07ea960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821dac3f-2bc2-4191-9c72-6f8cde304ed3', 'volume_name': 'volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe97e2d-8779-4f03-aad1-8dae38309c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe97e2d-8779-4f03-aad1-8dae38309c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e10a00-e353-4fc3-bb77-94d5af1f2a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:39 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3', 'volume_size': 1} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1380094684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821dac3f-2bc2-4191-9c72-6f8cde304ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6067784cf554e67afbeaa09eb9ba077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:01:39Z,use_quota=True,user_id='6db7bb0c56aa400d913be323465a0f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Creating volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:01:39 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:39 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 1073741824 Apr 02 20:01:39 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:39 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 1073741824" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:01:39 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:01:39 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:01:40 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e10a00-e353-4fc3-bb77-94d5af1f2a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bfbf85-2129-4ac2-bdf4-e52ffccdd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:01:40 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Volume volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 (821dac3f-2bc2-4191-9c72-6f8cde304ed3): created successfully Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bfbf85-2129-4ac2-bdf4-e52ffccdd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:01:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Flow 'volume_create_manager' (a7b2ec31-d146-466e-ba43-f0256872f173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:01:40 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-bf6047ab-d9c7-4b4f-b8b5-6fea9fc694a0 tempest-VolumesActionsTest-1727953627 None] Created volume successfully. Apr 02 20:01:50 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=37,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=3 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:01:50 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=40,cinder:INSERT=13,cinder:UPDATE=66,cinder:DELETE=7 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:01:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fa9422db-5986-4f45-8cc5-9c82ee207cb9 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" by "attach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fa9422db-5986-4f45-8cc5-9c82ee207cb9 tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" acquired by "attach_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fa9422db-5986-4f45-8cc5-9c82ee207cb9 tempest-VolumesActionsTest-1727953627 None] Attaching volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3 to instance 554e4266-bc8e-4e19-9d8a-186d3ad03f4f at mountpoint /dev/vdb on host None. Apr 02 20:01:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-fa9422db-5986-4f45-8cc5-9c82ee207cb9 tempest-VolumesActionsTest-1727953627 None] Attach volume completed successfully. Apr 02 20:01:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-fa9422db-5986-4f45-8cc5-9c82ee207cb9 tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" released by "attach_volume" :: held 0.057s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:01:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f0fbd43a-afe5-4f0f-b5cb-bbabeb246911 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" by "detach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:01:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f0fbd43a-afe5-4f0f-b5cb-bbabeb246911 tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:01:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f0fbd43a-afe5-4f0f-b5cb-bbabeb246911 tempest-VolumesActionsTest-1727953627 None] Detaching volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3 from instance 554e4266-bc8e-4e19-9d8a-186d3ad03f4f. Apr 02 20:01:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f0fbd43a-afe5-4f0f-b5cb-bbabeb246911 tempest-VolumesActionsTest-1727953627 None] Detach volume completed successfully. Apr 02 20:01:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f0fbd43a-afe5-4f0f-b5cb-bbabeb246911 tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:05 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:02:05 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:06 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:02:06 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:07 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.403s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:02:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c9f73d96-ad03-42f2-bf56-72e39954d3bd tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" by "attach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c9f73d96-ad03-42f2-bf56-72e39954d3bd tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" acquired by "attach_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c9f73d96-ad03-42f2-bf56-72e39954d3bd tempest-VolumesActionsTest-1727953627 None] Attaching volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3 to instance 9087700c-c310-4afe-b4ae-edba14e5087d at mountpoint /dev/vdb on host None. Apr 02 20:02:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c9f73d96-ad03-42f2-bf56-72e39954d3bd tempest-VolumesActionsTest-1727953627 None] Attach volume completed successfully. Apr 02 20:02:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c9f73d96-ad03-42f2-bf56-72e39954d3bd tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3" released by "attach_volume" :: held 0.057s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-632cf96d-176a-45ce-b03f-474872f8c27e tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" by "detach_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-632cf96d-176a-45ce-b03f-474872f8c27e tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-632cf96d-176a-45ce-b03f-474872f8c27e tempest-VolumesActionsTest-1727953627 None] Detaching volume 821dac3f-2bc2-4191-9c72-6f8cde304ed3 from instance 9087700c-c310-4afe-b4ae-edba14e5087d. Apr 02 20:02:16 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-632cf96d-176a-45ce-b03f-474872f8c27e tempest-VolumesActionsTest-1727953627 None] Detach volume completed successfully. Apr 02 20:02:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-632cf96d-176a-45ce-b03f-474872f8c27e tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9231559-2157-4715-a9f4-f1f3deb1fbe4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:25 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:25 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:25 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d19ca-3f3c-4e69-93f8-41bc8e60de29]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:25 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:25 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:25 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0elag8r3pw.img {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:25 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0elag8r3pw.img Apr 02 20:02:25 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:26 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:02:27 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0elag8r3pw.img" returned: 0 in 1.856s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:27 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d048c0fb-143b-4769-9d85-546ce1ab044d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:27 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:27 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:28 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.564s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:28 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0elag8r3pw.img {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:02:28 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Converted 1024.00 MB image at 551.19 MB/s Apr 02 20:02:28 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] 7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0e was raw, no need to convert to raw {{(pid=82597) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.081s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Uploaded volume to glance image-id: 7ea6118f-56dd-4aeb-b2c5-4db17f3f6f0e. {{(pid=82597) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 20:02:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1cc2cf3f-af07-467c-8d1d-919b7e5cee65 tempest-VolumesActionsTest-1727953627 None] Copy volume to image completed successfully. Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[761be223-4d24-4ac5-9f38-f7a902595807]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:38 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:38 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:39 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.440s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d7386-6758-47e1-9e7f-4fe2933b846f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:39 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:39 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:39 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:39 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img Apr 02 20:02:39 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:41 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img" returned: 0 in 1.801s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87f525-8593-4196-82d9-3cb1218bb183]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:41 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:41 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:42 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.577s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:02:42 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Converted 1024.00 MB image at 568.07 MB/s Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] b997b288-9766-4086-9c62-7d8b76a832c2 was raw, converting to qcow2 {{(pid=82597) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c969596-e95c-4457-83d3-e78ef7db598c]: (4, 'raw') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:42 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img Apr 02 20:02:42 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:42 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:42 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img Apr 02 20:02:42 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:43 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img" returned: 1 in 0.436s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img' failed. Not Retrying. {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img /opt/stack/data/cinder/conversion/vol_upload__ympmowl {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:43 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img /opt/stack/data/cinder/conversion/vol_upload__ympmowl Apr 02 20:02:43 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:43 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img /opt/stack/data/cinder/conversion/vol_upload__ympmowl" returned: 0 in 0.644s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Image conversion details: src /opt/stack/data/cinder/conversion/821dac3f-2bc2-4191-9c72-6f8cde304ed3.temp_image.b997b288-9766-4086-9c62-7d8b76a832c20qe_vgeo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__ympmowl {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:02:43 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefdc306-016e-42b9-ab36-597bbe353445]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__ympmowl {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:43 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__ympmowl Apr 02 20:02:43 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:44 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__ympmowl" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.043s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Uploaded volume to glance image-id: b997b288-9766-4086-9c62-7d8b76a832c2. {{(pid=82597) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 20:02:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c0986b20-1c08-44c1-9541-3f17796b9045 tempest-VolumesActionsTest-1727953627 None] Copy volume to image completed successfully. Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Acquiring lock "cinder-quobyte-821dac3f-2bc2-4191-9c72-6f8cde304ed3" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "cinder-quobyte-821dac3f-2bc2-4191-9c72-6f8cde304ed3" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305cd3d-e6a5-4f65-b13b-7ca93442a9f9]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:45 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:45 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:45 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.440s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:45 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3 Apr 02 20:02:45 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:46 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-821dac3f-2bc2-4191-9c72-6f8cde304ed3" returned: 0 in 0.390s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "cinder-quobyte-821dac3f-2bc2-4191-9c72-6f8cde304ed3" released by "delete_volume" :: held 0.850s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Created reservations ['c5992fda-fb2e-42d4-841d-496c0b967c8e', '76179e2b-4b1a-4fcc-b3f3-a2f53e42baf0', 'e0941145-5149-4671-ba16-412363d73324', '514cdf25-97a2-43cc-9ffd-d427e5469f22'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:46 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:02:46 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:46 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:02:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Deleted volume successfully. Apr 02 20:02:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ec0bf4a7-005b-49ac-87ca-e8aeb8237dec tempest-VolumesActionsTest-1727953627 None] Lock "cinder-821dac3f-2bc2-4191-9c72-6f8cde304ed3-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Flow 'volume_create_manager' (f4ef84af-1764-4c47-87eb-bcb41676788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47afd12b-cc80-47ca-9b16-2865d384d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47afd12b-cc80-47ca-9b16-2865d384d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1428306175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b32a341-071b-49b2-a2a2-48faa459c6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a2fb4a0e514c0dae991a6a1cb29e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:02:50Z,use_quota=True,user_id='87330efc933143509db7145795bc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c1247-2cbe-4030-b65a-801c63c6b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c1247-2cbe-4030-b65a-801c63c6b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341b9d94-acff-4c4b-9fea-b1b8ddf71a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341b9d94-acff-4c4b-9fea-b1b8ddf71a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b32a341-071b-49b2-a2a2-48faa459c6e8', 'volume_name': 'volume-5b32a341-071b-49b2-a2a2-48faa459c6e8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd85c34-56a8-4f03-be63-e85992f98623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd85c34-56a8-4f03-be63-e85992f98623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f55e27-5838-4fb8-acd3-0a99038b9809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:50 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Volume 5b32a341-071b-49b2-a2a2-48faa459c6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b32a341-071b-49b2-a2a2-48faa459c6e8', 'volume_size': 1} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1428306175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b32a341-071b-49b2-a2a2-48faa459c6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a2fb4a0e514c0dae991a6a1cb29e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:02:50Z,use_quota=True,user_id='87330efc933143509db7145795bc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Creating volume 5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:02:50 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:50 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 1073741824 Apr 02 20:02:50 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:50 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 1073741824" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:50 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:02:50 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:50 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:02:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f55e27-5838-4fb8-acd3-0a99038b9809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b32a341-071b-49b2-a2a2-48faa459c6e8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c598034-1c92-477f-aa64-b8180ff7cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Volume volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 (5b32a341-071b-49b2-a2a2-48faa459c6e8): created successfully Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c598034-1c92-477f-aa64-b8180ff7cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Flow 'volume_create_manager' (f4ef84af-1764-4c47-87eb-bcb41676788f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:02:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-4ed2c6b2-06ef-42cd-977f-afad12d031f0 tempest-VolumesCloneTest-1373237147 None] Created volume successfully. Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Flow 'volume_create_manager' (b3dbbd39-b366-4e77-8ee2-59437d40454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992774f3-b9a7-475e-8cef-824fcc3ea36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992774f3-b9a7-475e-8cef-824fcc3ea36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1773808644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9785c1c1-d0f0-4e07-9802-b3a3272d7fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a2fb4a0e514c0dae991a6a1cb29e98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:02:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5b32a341-071b-49b2-a2a2-48faa459c6e8,status='creating',terminated_at=None,updated_at=2026-04-02T18:02:51Z,use_quota=True,user_id='87330efc933143509db7145795bc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ca60cb-b80f-42b2-b698-fa544715815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ca60cb-b80f-42b2-b698-fa544715815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df51feb2-b587-40a8-abb5-e80603ff0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df51feb2-b587-40a8-abb5-e80603ff0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9785c1c1-d0f0-4e07-9802-b3a3272d7fab', 'volume_name': 'volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab', 'volume_size': 2, 'source_volid': '5b32a341-071b-49b2-a2a2-48faa459c6e8', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f81194-6cfb-4649-bcb0-9ecc741be107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f81194-6cfb-4649-bcb0-9ecc741be107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d669cb-1fc5-4c11-9724-1997c3fd8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:51 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Volume 9785c1c1-d0f0-4e07-9802-b3a3272d7fab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab', 'volume_size': 2, 'source_volid': '5b32a341-071b-49b2-a2a2-48faa459c6e8', 'source_volstatus': 'available'} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:51 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Cloning volume 5b32a341-071b-49b2-a2a2-48faa459c6e8 to volume 9785c1c1-d0f0-4e07-9802-b3a3272d7fab Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Creating offline snapshot ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 of volume 5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84192ca-0fb4-4452-b9ec-094c752972be]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:51 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:02:51 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:51 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:51 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 1G Apr 02 20:02:51 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:52 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 1G" returned: 0 in 0.461s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:52 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:52 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:52 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.409s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:52 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 is being set with open permissions: ugo+rw Apr 02 20:02:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:52 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:52 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:53 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:53 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info Apr 02 20:02:53 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:53 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:53 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info is being set with open permissions: ugo+rw Apr 02 20:02:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:53 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info Apr 02 20:02:53 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:54 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.info" returned: 0 in 0.398s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] snapshot: ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8, volume: 9785c1c1-d0f0-4e07-9802-b3a3272d7fab, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a83a1-1521-4b59-823c-cbf62c0ba4f7]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:54 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:54 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:54 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.455s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b32a341-071b-49b2-a2a2-48faa459c6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf106563-6b56-4135-9720-83c6e2c2e3d3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:54 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:02:54 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:54 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:02:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:55 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab Apr 02 20:02:55 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:56 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" returned: 0 in 1.986s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[70919ba7-35b4-41a3-ad99-e0ea6e57d347]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:57 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:02:57 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:57 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.566s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:02:57 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Converted 1024.00 MB image at 515.06 MB/s Apr 02 20:02:57 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab is being set with open permissions: ugo+rw Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:57 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab Apr 02 20:02:57 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:57 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" returned: 0 in 0.380s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" released by "_copy_volume_from_snapshot" :: held 3.879s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-quobyte-ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Deleting offline snapshot ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 of volume 5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] snapshot_file for this snap is: volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7c4c2-9244-497d-9d3a-32cb71de5547]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:58 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:58 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:58 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b32a341-071b-49b2-a2a2-48faa459c6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0ebd3-8e96-407f-a387-b60474826b2a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:58 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:02:58 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:58 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.432s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:58 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:58 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:59 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.427s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:02:59 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8 Apr 02 20:02:59 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:02:59 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8.ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" returned: 0 in 0.382s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-ba4cf8a2-10a9-4dfc-bf07-a7f009855bc8" released by "_delete_snapshot" :: held 1.746s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.265s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d669cb-1fc5-4c11-9724-1997c3fd8795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab', 'volume_size': 2, 'source_volid': '5b32a341-071b-49b2-a2a2-48faa459c6e8', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74de4463-ac09-4de5-86fe-636a7417f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:02:59 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Volume volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab (9785c1c1-d0f0-4e07-9802-b3a3272d7fab): created successfully Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74de4463-ac09-4de5-86fe-636a7417f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:02:59 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Flow 'volume_create_manager' (b3dbbd39-b366-4e77-8ee2-59437d40454e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:02:59 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-adb05a18-87c5-4462-90db-b303a48e8b73 tempest-VolumesCloneTest-1373237147 None] Created volume successfully. Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-9785c1c1-d0f0-4e07-9802-b3a3272d7fab-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-9785c1c1-d0f0-4e07-9802-b3a3272d7fab-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8f88e8-7644-4519-9bc6-85c49ab04c56]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:00 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab Apr 02 20:03:00 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:00 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:00 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab Apr 02 20:03:00 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:01 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-9785c1c1-d0f0-4e07-9802-b3a3272d7fab" released by "delete_volume" :: held 0.857s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Created reservations ['a71360f7-0930-4158-819f-b316f1f56298', 'd0616775-4da9-4061-993f-b402ae42fb67', 'c9a59406-634d-4dc2-bc36-4ed437602675', '021609aa-0f4c-4185-87e3-39b310130819'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:01 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:01 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-5b32a341-071b-49b2-a2a2-48faa459c6e8-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "cinder-5b32a341-071b-49b2-a2a2-48faa459c6e8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Acquiring lock "cinder-quobyte-5b32a341-071b-49b2-a2a2-48faa459c6e8" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-5b32a341-071b-49b2-a2a2-48faa459c6e8" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0de47c-f05a-4733-a4c0-b59cc83a8859]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:01 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:03:01 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:01 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Deleted volume successfully. Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-20a2982c-cf40-4ff4-97ad-b03b5a24b765 tempest-VolumesCloneTest-1373237147 None] Lock "cinder-9785c1c1-d0f0-4e07-9802-b3a3272d7fab-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:01 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:01 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8 Apr 02 20:03:01 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:02 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5b32a341-071b-49b2-a2a2-48faa459c6e8" returned: 0 in 0.416s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "cinder-quobyte-5b32a341-071b-49b2-a2a2-48faa459c6e8" released by "delete_volume" :: held 0.882s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Created reservations ['88012050-2e03-44cc-981e-de7fef51f000', '1baad54d-e301-400d-9ce5-b22987f3a084', 'b2f6e76f-25e9-41c0-a134-16fdea9960c3', '66982669-9a0c-4d52-9a38-b0c69cb1def0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:02 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:02 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:02 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.467s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:02 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Deleted volume successfully. Apr 02 20:03:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ded10730-5ba4-4650-984f-d04607c288dc tempest-VolumesCloneTest-1373237147 None] Lock "cinder-5b32a341-071b-49b2-a2a2-48faa459c6e8-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Flow 'volume_create_manager' (e9766f5e-55f3-46a0-89cf-10e940647260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8f99fb-a344-40e0-af7f-e91744030e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8f99fb-a344-40e0-af7f-e91744030e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1605148814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c645ec52-79ff-48f9-8c9e-a4989432ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7627cb7c1f4243ee9991bd8dacb0ed92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:04Z,use_quota=True,user_id='15a8d5c7ba044cd78824136db8f5dc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48057700-bce4-45b5-8a1e-d2ac9291eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:03 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48057700-bce4-45b5-8a1e-d2ac9291eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa92d709-cfb4-4366-85d5-9ff81082c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa92d709-cfb4-4366-85d5-9ff81082c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c645ec52-79ff-48f9-8c9e-a4989432ccb8', 'volume_name': 'volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e73dfe-9630-4a65-97e2-19cc992c7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e73dfe-9630-4a65-97e2-19cc992c7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdd4e0f-df2a-4840-8378-6147185b6ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:04 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Volume c645ec52-79ff-48f9-8c9e-a4989432ccb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8', 'volume_size': 1} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1605148814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c645ec52-79ff-48f9-8c9e-a4989432ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7627cb7c1f4243ee9991bd8dacb0ed92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:04Z,use_quota=True,user_id='15a8d5c7ba044cd78824136db8f5dc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Creating volume c645ec52-79ff-48f9-8c9e-a4989432ccb8 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:04 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:04 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 1073741824 Apr 02 20:03:04 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:04 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 1073741824" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:04 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 Apr 02 20:03:04 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:04 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8" returned: 0 in 0.380s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbdd4e0f-df2a-4840-8378-6147185b6ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb29a082-ec86-40fc-813f-0344c9cefa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:04 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Volume volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 (c645ec52-79ff-48f9-8c9e-a4989432ccb8): created successfully Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb29a082-ec86-40fc-813f-0344c9cefa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:04 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Flow 'volume_create_manager' (e9766f5e-55f3-46a0-89cf-10e940647260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:04 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e30cd4f2-027a-4daf-a176-68ef766345b7 tempest-VolumesNegativeTest-656042222 None] Created volume successfully. Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:06 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:06 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:07 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.405s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=41,cinder:INSERT=11,cinder:UPDATE=45,cinder:DELETE=2 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:03:14 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=4 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Acquiring lock "cinder-c645ec52-79ff-48f9-8c9e-a4989432ccb8-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "cinder-c645ec52-79ff-48f9-8c9e-a4989432ccb8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Acquiring lock "cinder-quobyte-c645ec52-79ff-48f9-8c9e-a4989432ccb8" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "cinder-quobyte-c645ec52-79ff-48f9-8c9e-a4989432ccb8" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d8cb94-6cb3-42c3-9568-c2b550ee7dfe]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:28 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 Apr 02 20:03:28 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:29 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:29 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8 Apr 02 20:03:29 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:29 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c645ec52-79ff-48f9-8c9e-a4989432ccb8" returned: 0 in 0.386s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "cinder-quobyte-c645ec52-79ff-48f9-8c9e-a4989432ccb8" released by "delete_volume" :: held 0.869s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Created reservations ['3a093658-6c5a-4412-8798-2789f4834fe5', '12f589c3-ab65-4e09-ab06-3fa6d0c1800d', 'db52f304-3783-4f03-83db-9f14c746e332', 'bd5771bb-6fa4-42d0-ac1c-d2803dc89956'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:29 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:29 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:30 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:30 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Deleted volume successfully. Apr 02 20:03:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f62dcff6-ca5e-480a-bf8c-128e9a3773ee tempest-VolumesNegativeTest-656042222 None] Lock "cinder-c645ec52-79ff-48f9-8c9e-a4989432ccb8-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Flow 'volume_create_manager' (54d2779c-38a2-4041-abe3-422e706010c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ba4c0d-59f7-4c25-9707-de46a7dc1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ba4c0d-59f7-4c25-9707-de46a7dc1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-923144890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ca619-d1b8-4dfd-8e9c-7d64fb65d627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b90ffa40b4cf69199197b37f7eb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:31Z,use_quota=True,user_id='fd7fd94f5c7e48b28227901bf3098c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fe39ba-1c22-4194-9ad9-f7f557e9f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fe39ba-1c22-4194-9ad9-f7f557e9f84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98036289-a0bc-40de-b31c-998a2d4db4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98036289-a0bc-40de-b31c-998a2d4db4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441ca619-d1b8-4dfd-8e9c-7d64fb65d627', 'volume_name': 'volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627', 'volume_size': 2}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f73930c-97a1-48eb-9b63-65a2400a2ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f73930c-97a1-48eb-9b63-65a2400a2ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde93d7b-bbd2-486d-a1a4-d5a0f200da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:31 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Volume 441ca619-d1b8-4dfd-8e9c-7d64fb65d627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627', 'volume_size': 2} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-923144890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441ca619-d1b8-4dfd-8e9c-7d64fb65d627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17b90ffa40b4cf69199197b37f7eb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:31Z,use_quota=True,user_id='fd7fd94f5c7e48b28227901bf3098c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Creating volume 441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:31 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 2147483648 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:31 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 2147483648 Apr 02 20:03:31 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:32 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 2147483648" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:32 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 Apr 02 20:03:32 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:32 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" returned: 0 in 0.388s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde93d7b-bbd2-486d-a1a4-d5a0f200da59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627', 'volume_size': 2}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698978f-0dde-4e74-a9ab-e74cf8d37577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:32 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Volume volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 (441ca619-d1b8-4dfd-8e9c-7d64fb65d627): created successfully Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698978f-0dde-4e74-a9ab-e74cf8d37577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:32 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Flow 'volume_create_manager' (54d2779c-38a2-4041-abe3-422e706010c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7eeb69b3-2ca8-46cf-ae2c-9d1c9829cb0b tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Created volume successfully. Apr 02 20:03:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Creating offline snapshot cd9cad40-0fa6-4ff7-834b-f45d8068a26b of volume 441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:03:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a453b-6527-45ab-8eff-141b29427f1b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:33 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 Apr 02 20:03:33 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:34 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" returned: 0 in 0.470s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b 2G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:34 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b 2G Apr 02 20:03:34 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:34 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b 2G" returned: 0 in 0.459s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:34 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b Apr 02 20:03:34 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:35 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:35 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b is being set with open permissions: ugo+rw Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:35 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b Apr 02 20:03:35 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:35 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b" returned: 0 in 0.393s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:35 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info Apr 02 20:03:35 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:35 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:35 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info is being set with open permissions: ugo+rw Apr 02 20:03:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:35 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info Apr 02 20:03:35 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:36 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.info" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:36 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-44ceb6ca-9992-4283-b9b6-706410f5cc23 tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Create snapshot completed successfully Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "cinder-cd9cad40-0fa6-4ff7-834b-f45d8068a26b-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-cd9cad40-0fa6-4ff7-834b-f45d8068a26b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "cinder-quobyte-cd9cad40-0fa6-4ff7-834b-f45d8068a26b" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-cd9cad40-0fa6-4ff7-834b-f45d8068a26b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Deleting offline snapshot cd9cad40-0fa6-4ff7-834b-f45d8068a26b of volume 441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] snapshot_file for this snap is: volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e303e4a-04f4-4af6-a498-2740008cc2d1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:36 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b Apr 02 20:03:36 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:37 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eefaca5-8c9f-493c-82cf-e7428b7b4991]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:37 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 Apr 02 20:03:37 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:37 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:37 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b Apr 02 20:03:37 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:38 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:38 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b Apr 02 20:03:38 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:38 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627.cd9cad40-0fa6-4ff7-834b-f45d8068a26b" returned: 0 in 0.386s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-cd9cad40-0fa6-4ff7-834b-f45d8068a26b" released by "_delete_snapshot" :: held 1.804s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" released by "delete_snapshot" :: held 1.816s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Created reservations ['aadaff8a-2a0e-4113-a1e9-c4ab30f28a98', '5c1b168a-c1e2-4572-8e8a-88d8bde16b04', '9de75347-8438-4268-84d6-7ac4a228bcfb', 'a98049d7-7326-4955-8d71-65612ae1801e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:38 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Delete snapshot completed successfully. Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-cd659143-af46-4563-b5b0-8b6bf34ff7ff tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-cd9cad40-0fa6-4ff7-834b-f45d8068a26b-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "cinder-441ca619-d1b8-4dfd-8e9c-7d64fb65d627-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:38 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-441ca619-d1b8-4dfd-8e9c-7d64fb65d627-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef975ab-acd3-4cc1-9f24-b1c40092146c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:39 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 Apr 02 20:03:39 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:39 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:39 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627 Apr 02 20:03:39 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:39 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" returned: 0 in 0.378s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-quobyte-441ca619-d1b8-4dfd-8e9c-7d64fb65d627" released by "delete_volume" :: held 0.860s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Created reservations ['5a5d0049-5a01-4f70-83b8-8c01a15fbeb8', 'b3e423b1-e2b3-49ed-934c-8a03df714399', '7ab37df4-3b7b-45b9-a49c-96a3f0150e1c', '9d127e40-2c1f-4423-b312-387d51f91f6c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:39 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:39 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:40 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:40 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:40 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Deleted volume successfully. Apr 02 20:03:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-10a51523-8ad3-4bf8-8a9a-38159fa65f8f tempest-VolumesSnapshotNegativeTestJSON-1283284935 None] Lock "cinder-441ca619-d1b8-4dfd-8e9c-7d64fb65d627-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (9d124dda-bcf0-4ace-89d4-570b62634d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a409ad01-604a-42fe-8a31-b808beb16d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a409ad01-604a-42fe-8a31-b808beb16d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226042137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5d4d65-47c2-4e73-9c6a-0a92f90e999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:42Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7f8d3-14c8-4a03-8977-33dc4985b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7f8d3-14c8-4a03-8977-33dc4985b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39068824-3825-4dad-bc0e-ae03389edcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39068824-3825-4dad-bc0e-ae03389edcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5d4d65-47c2-4e73-9c6a-0a92f90e999c', 'volume_name': 'volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd834fe-1fae-4a82-9b22-6b4e47ba55b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd834fe-1fae-4a82-9b22-6b4e47ba55b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee365f93-82a7-4cf4-96b7-be7d3fe04146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume ec5d4d65-47c2-4e73-9c6a-0a92f90e999c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c', 'volume_size': 1} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226042137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5d4d65-47c2-4e73-9c6a-0a92f90e999c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:42Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:41 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:41 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c 1073741824 Apr 02 20:03:41 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:42 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c 1073741824" returned: 0 in 0.489s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:42 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c Apr 02 20:03:42 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:42 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" returned: 0 in 0.386s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee365f93-82a7-4cf4-96b7-be7d3fe04146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115091bb-80eb-4061-8650-7ca1b8b5f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c (ec5d4d65-47c2-4e73-9c6a-0a92f90e999c): created successfully Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115091bb-80eb-4061-8650-7ca1b8b5f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (9d124dda-bcf0-4ace-89d4-570b62634d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-22e83083-97d3-4203-8fdb-422fefcfba04 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating offline snapshot 1533cdd7-dfad-41f8-ac0a-2bb31af740b8 of volume ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230b6aa-4754-4f1c-a09d-fe08c3a621d0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:42 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c Apr 02 20:03:42 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:43 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:43 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 1G Apr 02 20:03:43 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:43 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 1G" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:43 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 Apr 02 20:03:43 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:44 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8" returned: 0 in 0.411s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:44 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 is being set with open permissions: ugo+rw Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:44 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 Apr 02 20:03:44 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:44 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8" returned: 0 in 0.379s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:44 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info Apr 02 20:03:44 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:44 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info" returned: 0 in 0.405s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:44 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info is being set with open permissions: ugo+rw Apr 02 20:03:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:44 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info Apr 02 20:03:44 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:45 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.info" returned: 0 in 0.383s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-605822fa-c901-40d6-bf08-a82d9d6399b5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Create snapshot completed successfully Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (6f6c1f7c-04db-4a5a-abef-7481de2cb0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28701e6a-0674-4c88-9a23-65db9b8aabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28701e6a-0674-4c88-9a23-65db9b8aabfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121598082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e673d30-b7ec-4f6c-af15-eb469d642ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7201cf3-4acc-4302-a39e-24443f3b2c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7201cf3-4acc-4302-a39e-24443f3b2c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df93d7d-03ac-4c95-99c1-b17bef8b9808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df93d7d-03ac-4c95-99c1-b17bef8b9808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e673d30-b7ec-4f6c-af15-eb469d642ba2', 'volume_name': 'volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b40950-84c6-42ff-9f8c-9112cefef0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b40950-84c6-42ff-9f8c-9112cefef0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276aefa2-6643-411c-9157-e28140d2b5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume 3e673d30-b7ec-4f6c-af15-eb469d642ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2', 'volume_size': 1} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121598082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e673d30-b7ec-4f6c-af15-eb469d642ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume 3e673d30-b7ec-4f6c-af15-eb469d642ba2 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:46 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 1073741824 Apr 02 20:03:46 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (3224bffd-9066-4271-847c-33b9a2176d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c286b1-fc36-4e8b-9722-04f83a97e23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c286b1-fc36-4e8b-9722-04f83a97e23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-689176407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386fcb53-f985-4052-9c5e-979d18053387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad99a9e-8419-4bbf-8be0-157539dd1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad99a9e-8419-4bbf-8be0-157539dd1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e974ca-c336-4784-a704-5b0fba7bf1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e974ca-c336-4784-a704-5b0fba7bf1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386fcb53-f985-4052-9c5e-979d18053387', 'volume_name': 'volume-386fcb53-f985-4052-9c5e-979d18053387', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c765bef0-d4fc-42a8-a648-b83a976100f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c765bef0-d4fc-42a8-a648-b83a976100f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bae49-dc26-4f33-a2f4-49a4344af4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume 386fcb53-f985-4052-9c5e-979d18053387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386fcb53-f985-4052-9c5e-979d18053387', 'volume_size': 1} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (4f012285-b754-4c0e-932f-752415471d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da06fb2-1f47-436e-9acf-af57eb554bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da06fb2-1f47-436e-9acf-af57eb554bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744085589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd045b-b7bd-435d-a503-dfd2b41d3610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e10fd82-80d4-424a-bae1-032fc7d20376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e10fd82-80d4-424a-bae1-032fc7d20376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80db6e6b-1557-4aba-8157-3fb2a57bbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80db6e6b-1557-4aba-8157-3fb2a57bbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffd045b-b7bd-435d-a503-dfd2b41d3610', 'volume_name': 'volume-cffd045b-b7bd-435d-a503-dfd2b41d3610', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adafdebe-bda6-4143-a73e-b36b37a3dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adafdebe-bda6-4143-a73e-b36b37a3dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ece93c-321d-4e2e-99fa-862fa1b7c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume cffd045b-b7bd-435d-a503-dfd2b41d3610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffd045b-b7bd-435d-a503-dfd2b41d3610', 'volume_size': 1} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (69aa0358-f937-454b-9b35-a4a8cecd2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cb745a-2844-4c62-9b91-1591d5971313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cb745a-2844-4c62-9b91-1591d5971313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-985519204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0424f793-14f5-4a80-a90a-f25b615da805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:47Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf5366-4c2b-4301-b609-48ecc0663740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf5366-4c2b-4301-b609-48ecc0663740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae46676d-4313-4641-8bae-091c45555c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae46676d-4313-4641-8bae-091c45555c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0424f793-14f5-4a80-a90a-f25b615da805', 'volume_name': 'volume-0424f793-14f5-4a80-a90a-f25b615da805', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1e85dd-128b-4f8f-b621-8c682b9981a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1e85dd-128b-4f8f-b621-8c682b9981a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7227bd-fa4d-4e86-bd68-e234f2565bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume 0424f793-14f5-4a80-a90a-f25b615da805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0424f793-14f5-4a80-a90a-f25b615da805', 'volume_size': 1} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:46 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 1073741824" returned: 0 in 0.581s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:46 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 Apr 02 20:03:46 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (d1536150-2895-44d1-9ec4-75f3dd99c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a03c850-0098-448d-bcc7-bc3fcc292cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a03c850-0098-448d-bcc7-bc3fcc292cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1337760788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ee6dd9-c24b-47f5-861a-f442f761f1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:47Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b269181-6e47-48b3-af9b-2c884b6d687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b269181-6e47-48b3-af9b-2c884b6d687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a3094-e399-40a2-b6f1-eb7aaf1a1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a3094-e399-40a2-b6f1-eb7aaf1a1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ee6dd9-c24b-47f5-861a-f442f761f1c7', 'volume_name': 'volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b74bc3c-329e-4cea-8045-abd7da9b9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b74bc3c-329e-4cea-8045-abd7da9b9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e404bc-e135-410b-91e8-6896b7aa90ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume f0ee6dd9-c24b-47f5-861a-f442f761f1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7', 'volume_size': 1} Apr 02 20:03:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:47 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2" returned: 0 in 0.396s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-689176407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386fcb53-f985-4052-9c5e-979d18053387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume 386fcb53-f985-4052-9c5e-979d18053387 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:47 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276aefa2-6643-411c-9157-e28140d2b5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbb4559-d36d-4244-a5c0-758674e00de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:47 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 1073741824 Apr 02 20:03:47 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:47 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 (3e673d30-b7ec-4f6c-af15-eb469d642ba2): created successfully Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbb4559-d36d-4244-a5c0-758674e00de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (6f6c1f7c-04db-4a5a-abef-7481de2cb0ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2a8fd6fa-9bb9-4ac7-956f-5e74ccacbde5 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:47 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 1073741824" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:47 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 Apr 02 20:03:47 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:48 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387" returned: 0 in 0.391s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744085589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffd045b-b7bd-435d-a503-dfd2b41d3610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:46Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume cffd045b-b7bd-435d-a503-dfd2b41d3610 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:48 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64bae49-dc26-4f33-a2f4-49a4344af4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386fcb53-f985-4052-9c5e-979d18053387', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6f1f90-58bd-4e27-8b5e-71a6fd418fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:48 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 1073741824 Apr 02 20:03:48 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:48 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-386fcb53-f985-4052-9c5e-979d18053387 (386fcb53-f985-4052-9c5e-979d18053387): created successfully Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6f1f90-58bd-4e27-8b5e-71a6fd418fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (3224bffd-9066-4271-847c-33b9a2176d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1238848c-c16b-447c-a823-1830a9e43e60 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:48 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 1073741824" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:48 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 Apr 02 20:03:48 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:48 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-985519204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0424f793-14f5-4a80-a90a-f25b615da805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:47Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume 0424f793-14f5-4a80-a90a-f25b615da805 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:48 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ece93c-321d-4e2e-99fa-862fa1b7c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffd045b-b7bd-435d-a503-dfd2b41d3610', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3bf764-68a0-40cd-81e4-878392246b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:48 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 1073741824 Apr 02 20:03:48 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 (cffd045b-b7bd-435d-a503-dfd2b41d3610): created successfully Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3bf764-68a0-40cd-81e4-878392246b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (4f012285-b754-4c0e-932f-752415471d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-2524b38b-0ac3-48a5-b52f-0d93ed52ad14 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:49 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 1073741824" returned: 0 in 0.463s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:49 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 Apr 02 20:03:49 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:49 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1337760788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ee6dd9-c24b-47f5-861a-f442f761f1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687919abf17f4401bdae1d739b1ca991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:03:47Z,use_quota=True,user_id='4c35cb3be5c54780acb6d7a8bf415c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Creating volume f0ee6dd9-c24b-47f5-861a-f442f761f1c7 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:03:49 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7227bd-fa4d-4e86-bd68-e234f2565bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0424f793-14f5-4a80-a90a-f25b615da805', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:49 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 1073741824 Apr 02 20:03:49 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e36243a-504b-4e74-8964-dc89feb99a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:49 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-0424f793-14f5-4a80-a90a-f25b615da805 (0424f793-14f5-4a80-a90a-f25b615da805): created successfully Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e36243a-504b-4e74-8964-dc89feb99a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:49 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (69aa0358-f937-454b-9b35-a4a8cecd2000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3df88b82-0ca4-4516-b9f8-412096e7733e tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:50 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 1073741824" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:50 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 Apr 02 20:03:50 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:50 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" returned: 0 in 0.384s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e404bc-e135-410b-91e8-6896b7aa90ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8e3216-4d46-400d-be11-dc12f13a3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:03:50 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Volume volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 (f0ee6dd9-c24b-47f5-861a-f442f761f1c7): created successfully Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8e3216-4d46-400d-be11-dc12f13a3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:03:50 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Flow 'volume_create_manager' (d1536150-2895-44d1-9ec4-75f3dd99c614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:03:50 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-358c0717-1f01-42a2-97a0-4be52cf149ed tempest-CreateVolumesFromSnapshotTest-84666975 None] Created volume successfully. Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-f0ee6dd9-c24b-47f5-861a-f442f761f1c7-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-f0ee6dd9-c24b-47f5-861a-f442f761f1c7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[592f7965-1aed-4688-bb34-29794abe1452]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:51 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 Apr 02 20:03:51 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:51 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" returned: 0 in 0.445s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:51 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7 Apr 02 20:03:51 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:52 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" returned: 0 in 0.390s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-f0ee6dd9-c24b-47f5-861a-f442f761f1c7" released by "delete_volume" :: held 0.858s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['41dbb4f4-465e-46bb-84db-7ec7d1aa5beb', '53e524e1-d4d9-4934-b885-8c1203181d3f', '9eebfa10-6c2a-4877-9aa1-f9d494fdf073', '60149c24-196f-4325-9f1f-f66c5cdcb3a1'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:52 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:52 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-0424f793-14f5-4a80-a90a-f25b615da805-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-0424f793-14f5-4a80-a90a-f25b615da805-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-0424f793-14f5-4a80-a90a-f25b615da805" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-0424f793-14f5-4a80-a90a-f25b615da805" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17da5a-e117-4990-a765-7b8c759e5500]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:52 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 Apr 02 20:03:52 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:52 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.427s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:52 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c944d296-c6e8-476f-a33b-4c2ed127a202 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-f0ee6dd9-c24b-47f5-861a-f442f761f1c7-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:52 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805" returned: 0 in 0.452s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:52 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805 Apr 02 20:03:52 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:53 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0424f793-14f5-4a80-a90a-f25b615da805" returned: 0 in 0.399s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-0424f793-14f5-4a80-a90a-f25b615da805" released by "delete_volume" :: held 0.871s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['5437a202-ea81-459a-9407-e71594df3763', '9e8a4cdf-2989-4378-97ae-19e224cf140c', 'b103018e-08d8-404d-aacf-e75816ed215d', '5776e0f4-010c-46bd-b886-97774ce4e3ca'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:53 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:53 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-cffd045b-b7bd-435d-a503-dfd2b41d3610-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-cffd045b-b7bd-435d-a503-dfd2b41d3610-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-cffd045b-b7bd-435d-a503-dfd2b41d3610" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-cffd045b-b7bd-435d-a503-dfd2b41d3610" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e81748-e817-406c-bf34-6e73e4a4ed87]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:53 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 Apr 02 20:03:53 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:53 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:53 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-19fd4653-8441-4ab9-9df0-ddc7898774d4 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-0424f793-14f5-4a80-a90a-f25b615da805-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:53 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:53 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:54 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610 Apr 02 20:03:54 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:54 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cffd045b-b7bd-435d-a503-dfd2b41d3610" returned: 0 in 0.380s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-cffd045b-b7bd-435d-a503-dfd2b41d3610" released by "delete_volume" :: held 0.845s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['1dbc8f29-ec18-4e85-ac8b-7432e75cd161', '8370d508-8a93-4439-9a97-b4a8e26ed2da', '72f5e7fd-fc16-4a1e-b56b-b3d7c4515dde', '306fe964-7851-4dd5-b9f8-a0a5a0bf892e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:54 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:54 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-386fcb53-f985-4052-9c5e-979d18053387-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-386fcb53-f985-4052-9c5e-979d18053387-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-386fcb53-f985-4052-9c5e-979d18053387" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-386fcb53-f985-4052-9c5e-979d18053387" acquired by "delete_volume" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[3154900e-0e44-455a-b1e0-2a61ace9c748]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:54 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 Apr 02 20:03:54 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:54 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.413s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:54 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:03:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-06c22e1d-cc32-44b9-9213-0b6f3cecb372 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-cffd045b-b7bd-435d-a503-dfd2b41d3610-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:55 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387" returned: 0 in 0.472s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:55 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387 Apr 02 20:03:55 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:55 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-386fcb53-f985-4052-9c5e-979d18053387" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-386fcb53-f985-4052-9c5e-979d18053387" released by "delete_volume" :: held 0.876s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['5a8e26ec-9a59-4ed6-9d42-5f429da76d0e', '579119a2-cad3-4cfd-aa22-9d515b2e18bc', '881cf6f5-87ba-49aa-b633-f6c5088530ef', '893ce46d-4ba2-41db-8453-722f82f9e6ee'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:55 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:55 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-3e673d30-b7ec-4f6c-af15-eb469d642ba2-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-3e673d30-b7ec-4f6c-af15-eb469d642ba2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-3e673d30-b7ec-4f6c-af15-eb469d642ba2" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-3e673d30-b7ec-4f6c-af15-eb469d642ba2" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b111eb8-0daf-4168-982a-b80ed2ac71cd]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:55 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 Apr 02 20:03:55 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:56 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.411s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-7c450f58-af1a-4a16-a3c5-094671885f03 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-386fcb53-f985-4052-9c5e-979d18053387-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:56 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:56 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2 Apr 02 20:03:56 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:56 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3e673d30-b7ec-4f6c-af15-eb469d642ba2" returned: 0 in 0.386s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-3e673d30-b7ec-4f6c-af15-eb469d642ba2" released by "delete_volume" :: held 0.881s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['0611c5bf-7c7b-4a81-befd-9f66ff140fc3', '4bf900b0-36a4-4794-af0d-e7eac1c79571', 'dd69478b-7fc4-4c73-8f7e-0aa0fbf92fb9', 'fcdff821-673c-46b8-9c49-a65eed8e5dca'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:56 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:03:56 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-1533cdd7-dfad-41f8-ac0a-2bb31af740b8-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-1533cdd7-dfad-41f8-ac0a-2bb31af740b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-1533cdd7-dfad-41f8-ac0a-2bb31af740b8" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-1533cdd7-dfad-41f8-ac0a-2bb31af740b8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleting offline snapshot 1533cdd7-dfad-41f8-ac0a-2bb31af740b8 of volume ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] snapshot_file for this snap is: volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b4556-243a-459f-98f3-81b117d02ac1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:56 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 Apr 02 20:03:56 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:57 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.431s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:03:57 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3cde376b-21ff-4e91-8f48-b435857b783d tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-3e673d30-b7ec-4f6c-af15-eb469d642ba2-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:57 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8" returned: 0 in 0.456s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[6864c7a9-da78-438c-b518-37428a427677]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:57 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c Apr 02 20:03:57 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:57 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" returned: 0 in 0.438s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:57 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 Apr 02 20:03:57 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:58 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:58 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8 Apr 02 20:03:58 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:58 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c.1533cdd7-dfad-41f8-ac0a-2bb31af740b8" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-1533cdd7-dfad-41f8-ac0a-2bb31af740b8" released by "_delete_snapshot" :: held 1.754s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" released by "delete_snapshot" :: held 1.766s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['74c584c0-cc5a-4dcc-bec7-a429eb8500bb', '9b5be317-66ba-4ae0-92ef-fcc724f33f03', '544ac574-0973-4a5d-92a9-53ec2c93e8d3', '1acc3c0d-326a-4210-ae74-83080db0b73a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Delete snapshot completed successfully. Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-facc81dd-fc90-4e17-a695-b9726e87b6e3 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-1533cdd7-dfad-41f8-ac0a-2bb31af740b8-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[041d88cc-43e3-4501-af49-c30e216d1612]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:59 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c Apr 02 20:03:59 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:59 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" returned: 0 in 0.457s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:03:59 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c Apr 02 20:03:59 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:03:59 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" returned: 0 in 0.385s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-quobyte-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c" released by "delete_volume" :: held 0.869s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Created reservations ['256ae006-32b3-4920-8874-1689485f7866', 'dd29a8c9-99a3-4afd-802d-f58618e4e85d', 'd1989857-27ba-4abc-8389-ea186dc10e8d', '8623dc1b-b2ce-485d-959b-422187fc3460'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:03:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:00 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:00 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:00 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.425s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:00 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Deleted volume successfully. Apr 02 20:04:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-a8c363e2-fdc3-40ab-b424-06f72ff4a7e1 tempest-CreateVolumesFromSnapshotTest-84666975 None] Lock "cinder-ec5d4d65-47c2-4e73-9c6a-0a92f90e999c-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:06 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:06 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (baedafc2-c4bf-43be-805e-2fd32658f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caf2c4a-6c0b-4b47-a1d1-f15b6316196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caf2c4a-6c0b-4b47-a1d1-f15b6316196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450535222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac4082-41c7-413b-9df1-06549d9debcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b7e8cc-1385-414a-9426-7cb90684b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b7e8cc-1385-414a-9426-7cb90684b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b201f710-d9c1-48c4-9d53-f95926fea49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b201f710-d9c1-48c4-9d53-f95926fea49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ac4082-41c7-413b-9df1-06549d9debcb', 'volume_name': 'volume-13ac4082-41c7-413b-9df1-06549d9debcb', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9af6a-0e21-4023-9987-0c181d660b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9af6a-0e21-4023-9987-0c181d660b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3eb1e6-b373-47de-b5d2-a97e86d836a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume 13ac4082-41c7-413b-9df1-06549d9debcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ac4082-41c7-413b-9df1-06549d9debcb', 'volume_size': 1} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450535222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac4082-41c7-413b-9df1-06549d9debcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume 13ac4082-41c7-413b-9df1-06549d9debcb {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:07 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:07 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb 1073741824 Apr 02 20:04:07 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (ab445750-f49a-4e04-a222-b086aa03bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da2b690-fa97-4942-86b1-660f291cbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da2b690-fa97-4942-86b1-660f291cbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1802740425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe703c9-6367-4fe3-bdca-402cf0bd214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72768c8-482c-4c24-9668-d7df5cb306a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72768c8-482c-4c24-9668-d7df5cb306a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985d94e1-d063-45e0-9810-862557bdb53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985d94e1-d063-45e0-9810-862557bdb53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe703c9-6367-4fe3-bdca-402cf0bd214b', 'volume_name': 'volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e32f22-d9c5-49df-b86c-769c5ecbc7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e32f22-d9c5-49df-b86c-769c5ecbc7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725d7ac3-0808-4512-b95e-71b15dcb8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Volume cfe703c9-6367-4fe3-bdca-402cf0bd214b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b', 'volume_size': 1} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:07 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (b9082536-99e7-46f4-9956-d9413b605b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1551aa-4a3d-48eb-b9ec-cee6201f0b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1551aa-4a3d-48eb-b9ec-cee6201f0b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472328361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813c1c24-0a18-4d1b-931e-38b7fce944b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813c1c24-0a18-4d1b-931e-38b7fce944b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d685651-8c92-4413-ad1e-33df079565cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d685651-8c92-4413-ad1e-33df079565cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161', 'volume_name': 'volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d59d9-0d24-4067-89be-d80101deebc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d59d9-0d24-4067-89be-d80101deebc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f0e6be-cded-4e29-bbbf-f2a5a50d66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Volume e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161', 'volume_size': 1} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.825s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (d37a67bc-5973-4da8-9e50-6af55fc6d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e160961-73ef-4399-b917-50afae1ac53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e160961-73ef-4399-b917-50afae1ac53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255325097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ca6923-e91e-4f93-844f-89296b3cc0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54f20a-3403-4054-b663-a6086d20d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54f20a-3403-4054-b663-a6086d20d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90c4d9-4b60-47ad-b783-56f977d19d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90c4d9-4b60-47ad-b783-56f977d19d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ca6923-e91e-4f93-844f-89296b3cc0a7', 'volume_name': 'volume-39ca6923-e91e-4f93-844f-89296b3cc0a7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b08353a-67c3-4f39-b7b6-37cc2e1f31f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b08353a-67c3-4f39-b7b6-37cc2e1f31f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2602d6a8-eff9-45be-9cae-20de5185690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:07 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Volume 39ca6923-e91e-4f93-844f-89296b3cc0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ca6923-e91e-4f93-844f-89296b3cc0a7', 'volume_size': 1} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:07 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb 1073741824" returned: 0 in 0.597s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:07 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb Apr 02 20:04:07 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (74b0d623-e93f-49a2-adde-9270f138cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:07 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2749be2-50e2-4d5e-a6b2-2e4cf239ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2749be2-50e2-4d5e-a6b2-2e4cf239ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696116217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff978f5-e727-4c8e-9331-c041499da7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143b50ad-944d-4e6d-bb5b-6b044df168a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143b50ad-944d-4e6d-bb5b-6b044df168a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59389b31-7059-4824-ba60-8a72a2cf103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59389b31-7059-4824-ba60-8a72a2cf103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff978f5-e727-4c8e-9331-c041499da7e7', 'volume_name': 'volume-9ff978f5-e727-4c8e-9331-c041499da7e7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119512b1-9d1c-46ad-9a25-ec0fffc968c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119512b1-9d1c-46ad-9a25-ec0fffc968c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9609ad35-637d-43e7-a674-21cb973f7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Volume 9ff978f5-e727-4c8e-9331-c041499da7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff978f5-e727-4c8e-9331-c041499da7e7', 'volume_size': 1} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (8afb6751-e3c3-4a12-9eaf-af3a0e21bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e62cff-0074-406a-b949-d4263dbe4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e62cff-0074-406a-b949-d4263dbe4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603431283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e9e9f-4c39-413c-a2e7-7fa905108663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd16d4a-16a3-47e0-8882-52d3c5bbf74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd16d4a-16a3-47e0-8882-52d3c5bbf74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578f7dc4-3359-4d12-9b3c-34687a1e6af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578f7dc4-3359-4d12-9b3c-34687a1e6af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0e9e9f-4c39-413c-a2e7-7fa905108663', 'volume_name': 'volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095dc356-23c0-44a3-a6e6-885b715f54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095dc356-23c0-44a3-a6e6-885b715f54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e982fc-0a3f-4a8e-9e94-4b4090dbaaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Volume 8d0e9e9f-4c39-413c-a2e7-7fa905108663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663', 'volume_size': 1} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (45288d80-0a49-47fc-9338-79516d360dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054c2857-8449-4c4f-920b-37a51d898fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054c2857-8449-4c4f-920b-37a51d898fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543265810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f124578-cbbe-48df-a220-f27ac3355bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6ab217-5f7d-4e15-9af1-bb2d282f6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6ab217-5f7d-4e15-9af1-bb2d282f6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577a364-a26c-46a1-8207-7a24c70a62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577a364-a26c-46a1-8207-7a24c70a62f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f124578-cbbe-48df-a220-f27ac3355bc0', 'volume_name': 'volume-8f124578-cbbe-48df-a220-f27ac3355bc0', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43549d44-455c-4152-af51-f1da3a1ffc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43549d44-455c-4152-af51-f1da3a1ffc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86374e5-715e-4deb-8dbc-ff2da4df02d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Volume 8f124578-cbbe-48df-a220-f27ac3355bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f124578-cbbe-48df-a220-f27ac3355bc0', 'volume_size': 1} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:08 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb" returned: 0 in 0.567s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1802740425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe703c9-6367-4fe3-bdca-402cf0bd214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Creating volume cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3eb1e6-b373-47de-b5d2-a97e86d836a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ac4082-41c7-413b-9df1-06549d9debcb', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8010a0f6-030d-4263-b16c-88cb9b11e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:08 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b 1073741824 Apr 02 20:04:08 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-13ac4082-41c7-413b-9df1-06549d9debcb (13ac4082-41c7-413b-9df1-06549d9debcb): created successfully Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8010a0f6-030d-4263-b16c-88cb9b11e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:08 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (baedafc2-c4bf-43be-805e-2fd32658f368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:08 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c099a8ff-7a13-427d-916e-fce4e1c03119 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:09 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b 1073741824" returned: 0 in 0.519s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:09 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:09 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:09 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472328361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:07Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Creating volume e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:09 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725d7ac3-0808-4512-b95e-71b15dcb8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 1073741824 Apr 02 20:04:09 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38cfe23-b407-41c7-be5c-56eef23ff653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (71416f0c-77af-4be3-87d7-7575bfce09a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118b8e23-192e-43dd-a2e2-ad176379a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118b8e23-192e-43dd-a2e2-ad176379a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617560472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88c330-1c46-405f-bbc4-1c5dec8456ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c3c7d7-00f5-4dc9-a509-ae9168698a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c3c7d7-00f5-4dc9-a509-ae9168698a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0244b1d5-7b34-4d84-bb78-4225b4f0ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0244b1d5-7b34-4d84-bb78-4225b4f0ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af88c330-1c46-405f-bbc4-1c5dec8456ec', 'volume_name': 'volume-af88c330-1c46-405f-bbc4-1c5dec8456ec', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7e55c5-bd6b-49f9-a3a1-eb768145aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7e55c5-bd6b-49f9-a3a1-eb768145aee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4768a28-ee48-4f10-8609-ef95c25f5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume af88c330-1c46-405f-bbc4-1c5dec8456ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af88c330-1c46-405f-bbc4-1c5dec8456ec', 'volume_size': 1} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Volume volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b (cfe703c9-6367-4fe3-bdca-402cf0bd214b): created successfully Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38cfe23-b407-41c7-be5c-56eef23ff653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (ab445750-f49a-4e04-a222-b086aa03bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:09 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-25c84881-3ec3-4c9b-9849-41587f22b488 tempest-VolumeDependencyTests-1616403581 None] Created volume successfully. Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (eb745d4e-dd56-4be3-a332-16b0310cc854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c351be03-16cb-4b21-a0de-4070ae0bdfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c351be03-16cb-4b21-a0de-4070ae0bdfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554976814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f22284-fa11-4424-a6b9-5ffac09503e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cf3318-7836-4c83-b316-21e8a5cf6685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cf3318-7836-4c83-b316-21e8a5cf6685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed9b50-2194-4648-82fc-e96f947790dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed9b50-2194-4648-82fc-e96f947790dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f22284-fa11-4424-a6b9-5ffac09503e3', 'volume_name': 'volume-c9f22284-fa11-4424-a6b9-5ffac09503e3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a09842b-b3a0-41c3-a67f-2704414b762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a09842b-b3a0-41c3-a67f-2704414b762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5c3ff0-5368-40b7-9a59-64347e547dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:09 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume c9f22284-fa11-4424-a6b9-5ffac09503e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f22284-fa11-4424-a6b9-5ffac09503e3', 'volume_size': 1} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (bf398928-52f2-4176-8fa2-daa0b0405efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:09 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd3755-7d33-41f7-a514-be7ea985ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd3755-7d33-41f7-a514-be7ea985ac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489180049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7481858c-195d-4a68-9c0a-c98876e4e562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd03e58-ff05-4f48-9485-c4d2d59e9f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd03e58-ff05-4f48-9485-c4d2d59e9f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cceee71-af57-4659-a287-190e3157e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cceee71-af57-4659-a287-190e3157e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7481858c-195d-4a68-9c0a-c98876e4e562', 'volume_name': 'volume-7481858c-195d-4a68-9c0a-c98876e4e562', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcb16cb-b99f-4408-8994-3c7c72fe525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcb16cb-b99f-4408-8994-3c7c72fe525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c35a7d3-48d9-4aa9-8d77-32eae75a4dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume 7481858c-195d-4a68-9c0a-c98876e4e562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7481858c-195d-4a68-9c0a-c98876e4e562', 'volume_size': 1} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:10 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 1073741824" returned: 0 in 0.572s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:10 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 Apr 02 20:04:10 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (6bf7cdbb-fdc8-4164-922f-ecf599654fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe54b84f-7a7d-4842-a299-3de2fa8b343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe54b84f-7a7d-4842-a299-3de2fa8b343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072584710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16943130-8d17-4c92-8627-33a4fbb6cc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e1c27b-1512-47ea-a921-a01797fbc3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e1c27b-1512-47ea-a921-a01797fbc3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48014d8-4013-413b-9e65-9fdd503025b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48014d8-4013-413b-9e65-9fdd503025b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16943130-8d17-4c92-8627-33a4fbb6cc56', 'volume_name': 'volume-16943130-8d17-4c92-8627-33a4fbb6cc56', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0ba3c-452b-42ba-ae31-33306420e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c0ba3c-452b-42ba-ae31-33306420e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6584fd-a76f-4dec-9d29-0e91ad38b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume 16943130-8d17-4c92-8627-33a4fbb6cc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16943130-8d17-4c92-8627-33a4fbb6cc56', 'volume_size': 1} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (023aadc5-9e65-48b9-99f1-cc9c31122c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382c793d-636d-4a7f-99c8-16347159d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382c793d-636d-4a7f-99c8-16347159d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9031761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0fac1f-ec25-437d-b361-0bc320cd3a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0fac1f-ec25-437d-b361-0bc320cd3a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027182dd-dbc8-409b-81e8-d44b534e682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027182dd-dbc8-409b-81e8-d44b534e682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5', 'volume_name': 'volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8702b9a-40b8-4635-b7a1-93a726e30352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8702b9a-40b8-4635-b7a1-93a726e30352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97c86d8-cbc7-4219-8150-479d8e30a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume 4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5', 'volume_size': 1} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:10 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.964s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255325097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ca6923-e91e-4f93-844f-89296b3cc0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Creating volume 39ca6923-e91e-4f93-844f-89296b3cc0a7 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f0e6be-cded-4e29-bbbf-f2a5a50d66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 1073741824 Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6f2726-db92-43d4-b074-434ea2135fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:10 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Volume volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 (e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161): created successfully Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6f2726-db92-43d4-b074-434ea2135fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:10 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (b9082536-99e7-46f4-9956-d9413b605b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:10 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-26646574-84a8-4900-994a-9d2020a6dca2 tempest-CreateVolumesFromImageTest-152246863 None] Created volume successfully. Apr 02 20:04:11 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 1073741824" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:11 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 Apr 02 20:04:11 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:11 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7" returned: 0 in 0.390s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.618s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696116217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff978f5-e727-4c8e-9331-c041499da7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Creating volume 9ff978f5-e727-4c8e-9331-c041499da7e7 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:11 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2602d6a8-eff9-45be-9cae-20de5185690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ca6923-e91e-4f93-844f-89296b3cc0a7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:11 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 1073741824 Apr 02 20:04:11 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14df4fb8-d7ca-412e-a58a-803011bf0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:11 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Volume volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 (39ca6923-e91e-4f93-844f-89296b3cc0a7): created successfully Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14df4fb8-d7ca-412e-a58a-803011bf0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:11 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (d37a67bc-5973-4da8-9e50-6af55fc6d539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:11 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-0f89ec4e-7a98-4a3a-8d63-9e9a6a72bd2e tempest-CreateVolumesFromImageTest-152246863 None] Created volume successfully. Apr 02 20:04:12 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 1073741824" returned: 0 in 0.544s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:12 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 Apr 02 20:04:12 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:12 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603431283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e9e9f-4c39-413c-a2e7-7fa905108663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Creating volume 8d0e9e9f-4c39-413c-a2e7-7fa905108663 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:12 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9609ad35-637d-43e7-a674-21cb973f7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff978f5-e727-4c8e-9331-c041499da7e7', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986f3b0a-d949-4a78-9568-88cf32963c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:12 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 1073741824 Apr 02 20:04:12 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:12 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Volume volume-9ff978f5-e727-4c8e-9331-c041499da7e7 (9ff978f5-e727-4c8e-9331-c041499da7e7): created successfully Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986f3b0a-d949-4a78-9568-88cf32963c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:12 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (74b0d623-e93f-49a2-adde-9270f138cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:12 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-44d98731-1acc-4d8f-a877-9f8ab13e2031 tempest-CreateVolumesFromImageTest-152246863 None] Created volume successfully. Apr 02 20:04:13 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 1073741824" returned: 0 in 0.568s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:13 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 Apr 02 20:04:13 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:13 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663" returned: 0 in 0.422s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543265810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f124578-cbbe-48df-a220-f27ac3355bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306c0eeb7f6443689110df279e5c64c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:08Z,use_quota=True,user_id='301158a9d5e54779b0c5c99e385d4823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Creating volume 8f124578-cbbe-48df-a220-f27ac3355bc0 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:13 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e982fc-0a3f-4a8e-9e94-4b4090dbaaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc356a82-9710-41d7-9689-8f6e09efdf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:13 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 1073741824 Apr 02 20:04:13 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:13 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Volume volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 (8d0e9e9f-4c39-413c-a2e7-7fa905108663): created successfully Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc356a82-9710-41d7-9689-8f6e09efdf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:13 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (8afb6751-e3c3-4a12-9eaf-af3a0e21bad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:13 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f8a563ef-67bf-4b36-bf85-40b5dc3560d8 tempest-CreateVolumesFromImageTest-152246863 None] Created volume successfully. Apr 02 20:04:14 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 1073741824" returned: 0 in 0.518s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:14 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 Apr 02 20:04:14 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:14 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0" returned: 0 in 0.461s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.061s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617560472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af88c330-1c46-405f-bbc4-1c5dec8456ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume af88c330-1c46-405f-bbc4-1c5dec8456ec {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:14 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86374e5-715e-4deb-8dbc-ff2da4df02d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f124578-cbbe-48df-a220-f27ac3355bc0', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:14 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec 1073741824 Apr 02 20:04:14 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0d26a3-7642-42f8-9cc0-80aed86ab10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:14 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Volume volume-8f124578-cbbe-48df-a220-f27ac3355bc0 (8f124578-cbbe-48df-a220-f27ac3355bc0): created successfully Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0d26a3-7642-42f8-9cc0-80aed86ab10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:14 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Flow 'volume_create_manager' (45288d80-0a49-47fc-9338-79516d360dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:14 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c7dc5594-fab5-4c9a-899e-9ba9733a00e5 tempest-CreateVolumesFromImageTest-152246863 None] Created volume successfully. Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-8f124578-cbbe-48df-a220-f27ac3355bc0-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-8f124578-cbbe-48df-a220-f27ac3355bc0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-quobyte-8f124578-cbbe-48df-a220-f27ac3355bc0" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-8f124578-cbbe-48df-a220-f27ac3355bc0" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d84f9e-94c0-4e40-a19c-e71272859b0d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:15 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 Apr 02 20:04:15 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:15 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec 1073741824" returned: 0 in 0.510s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:15 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec Apr 02 20:04:15 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:15 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0" returned: 0 in 0.498s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:15 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0 Apr 02 20:04:15 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:15 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec" returned: 0 in 0.419s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.855s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554976814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f22284-fa11-4424-a6b9-5ffac09503e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume c9f22284-fa11-4424-a6b9-5ffac09503e3 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:15 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4768a28-ee48-4f10-8609-ef95c25f5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af88c330-1c46-405f-bbc4-1c5dec8456ec', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:15 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 1073741824 Apr 02 20:04:15 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64381b4-b8ee-41e5-9c71-9c27539f3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:15 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-af88c330-1c46-405f-bbc4-1c5dec8456ec (af88c330-1c46-405f-bbc4-1c5dec8456ec): created successfully Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64381b4-b8ee-41e5-9c71-9c27539f3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:15 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (71416f0c-77af-4be3-87d7-7575bfce09a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:15 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-90bd8bcf-f5a5-4302-ad74-079c191257d2 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:16 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8f124578-cbbe-48df-a220-f27ac3355bc0" returned: 0 in 0.620s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-8f124578-cbbe-48df-a220-f27ac3355bc0" released by "delete_volume" :: held 1.144s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Created reservations ['e3be9ff9-78be-40a6-9a3c-1a651718a6fe', 'd6f657f0-b9a5-41c1-a93c-9a4edf8e9f22', '74cb9cd2-b1cc-4be2-a967-9fece79ea163', '9554fe79-a158-4885-bb7c-814b8be38aed'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:16 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 1073741824" returned: 0 in 0.710s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:16 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:16 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:16 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 Apr 02 20:04:16 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:16 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3" returned: 0 in 0.536s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.929s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489180049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7481858c-195d-4a68-9c0a-c98876e4e562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume 7481858c-195d-4a68-9c0a-c98876e4e562 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:16 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:16 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:16 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.605s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5c3ff0-5368-40b7-9a59-64347e547dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f22284-fa11-4424-a6b9-5ffac09503e3', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c70aae5-3ef5-4b0e-8c19-96895af689d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:17 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 1073741824 Apr 02 20:04:17 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Deleted volume successfully. Apr 02 20:04:17 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 (c9f22284-fa11-4424-a6b9-5ffac09503e3): created successfully Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c70aae5-3ef5-4b0e-8c19-96895af689d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (eb745d4e-dd56-4be3-a332-16b0310cc854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:17 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f80f724f-7e36-4220-979b-a2736397ef0f tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-47578289-ffd9-4a0b-8960-137591236258 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-8f124578-cbbe-48df-a220-f27ac3355bc0-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-8d0e9e9f-4c39-413c-a2e7-7fa905108663-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-8d0e9e9f-4c39-413c-a2e7-7fa905108663-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-quobyte-8d0e9e9f-4c39-413c-a2e7-7fa905108663" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-8d0e9e9f-4c39-413c-a2e7-7fa905108663" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d7569-53f1-4c0d-82c3-86fb30138b98]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:17 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 Apr 02 20:04:17 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:17 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 1073741824" returned: 0 in 0.604s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:17 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 Apr 02 20:04:17 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:17 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:17 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:17 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663 Apr 02 20:04:17 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:18 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562" returned: 0 in 0.525s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.867s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072584710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16943130-8d17-4c92-8627-33a4fbb6cc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume 16943130-8d17-4c92-8627-33a4fbb6cc56 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:18 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c35a7d3-48d9-4aa9-8d77-32eae75a4dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7481858c-195d-4a68-9c0a-c98876e4e562', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:18 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 1073741824 Apr 02 20:04:18 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72abce2-9aa4-4617-bcdb-866be1fd3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:18 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-7481858c-195d-4a68-9c0a-c98876e4e562 (7481858c-195d-4a68-9c0a-c98876e4e562): created successfully Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72abce2-9aa4-4617-bcdb-866be1fd3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (bf398928-52f2-4176-8fa2-daa0b0405efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:18 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-736aab3a-bacf-4162-96a5-87f02c8a2fa4 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:18 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-8d0e9e9f-4c39-413c-a2e7-7fa905108663" returned: 0 in 0.409s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-8d0e9e9f-4c39-413c-a2e7-7fa905108663" released by "delete_volume" :: held 0.929s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Created reservations ['531ce473-8dd5-4d47-b65e-0b7985099429', 'cf2ac414-fd14-4146-afc1-d3d820f5ca7f', 'd2f30dd9-e58e-46d6-997c-f56db19cae53', '6d933889-ed49-4c56-8566-b87f39e50f5f'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:18 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:18 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-9ff978f5-e727-4c8e-9331-c041499da7e7-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-9ff978f5-e727-4c8e-9331-c041499da7e7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-quobyte-9ff978f5-e727-4c8e-9331-c041499da7e7" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-9ff978f5-e727-4c8e-9331-c041499da7e7" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba5e0a-f543-4561-a298-3979fa955197]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:18 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 Apr 02 20:04:18 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:18 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 1073741824" returned: 0 in 0.590s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:18 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 Apr 02 20:04:18 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:18 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.533s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:18 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Deleted volume successfully. Apr 02 20:04:18 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-52ed93c6-9edf-430d-8cab-cfad24c92cb4 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-8d0e9e9f-4c39-413c-a2e7-7fa905108663-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:19 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7" returned: 0 in 0.659s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:19 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7 Apr 02 20:04:19 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:19 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56" returned: 0 in 0.489s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.725s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-9031761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f77e04a456496a84efba20be247cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:10Z,use_quota=True,user_id='dbe75e4e22db4a49bd0ffe4b221a6167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Creating volume 4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:19 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6584fd-a76f-4dec-9d29-0e91ad38b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16943130-8d17-4c92-8627-33a4fbb6cc56', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ca860-abce-4fc7-bd81-3b44a2977561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:19 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-16943130-8d17-4c92-8627-33a4fbb6cc56 (16943130-8d17-4c92-8627-33a4fbb6cc56): created successfully Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ca860-abce-4fc7-bd81-3b44a2977561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:19 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 1073741824 Apr 02 20:04:19 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (6bf7cdbb-fdc8-4164-922f-ecf599654fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:19 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-046d9eb9-9a82-424b-9eae-cd2e5d60aa5e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:19 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-9ff978f5-e727-4c8e-9331-c041499da7e7" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-9ff978f5-e727-4c8e-9331-c041499da7e7" released by "delete_volume" :: held 1.130s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Created reservations ['3d85cf1c-820f-463f-99a3-88d2deb8bc93', 'b07b4ba1-0ed7-4c42-b726-771814d875f7', 'f3758e64-2820-4e57-99b9-1e411683cd44', '50c0e994-2e9a-4475-bb47-cbcbd5cf793e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:19 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:19 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:19 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 1073741824" returned: 0 in 0.632s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:19 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:19 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 Apr 02 20:04:19 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:20 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.467s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Deleted volume successfully. Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-983f48cf-c839-4362-a0f7-60184c366fa1 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-9ff978f5-e727-4c8e-9331-c041499da7e7-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Flow 'volume_create_manager' (b766421c-5716-4d79-a3cd-4aaf580fef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafe3058-421a-476c-a995-709d0c5b3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafe3058-421a-476c-a995-709d0c5b3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-169858694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fcbb0b-78d2-4007-a6fb-9d56a2d14662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e333fd76a60d4323b4aaf1d852319cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:20Z,use_quota=True,user_id='088c937bdc2640d49f4bfd39f436f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43324a-9bf9-40a1-b815-fbcb1b971c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43324a-9bf9-40a1-b815-fbcb1b971c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c78f90d-f308-428f-827f-f76df80cf416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c78f90d-f308-428f-827f-f76df80cf416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fcbb0b-78d2-4007-a6fb-9d56a2d14662', 'volume_name': 'volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97acc9-c8ed-4000-a242-3b3a5ddc13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97acc9-c8ed-4000-a242-3b3a5ddc13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6273f68c-2d43-436d-819b-f798a0c79df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Volume 01fcbb0b-78d2-4007-a6fb-9d56a2d14662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662', 'volume_size': 1} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:20 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.816s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97c86d8-cbc7-4219-8150-479d8e30a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bbf433-4065-42cc-b83b-ff8da1d72ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:20 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Volume volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 (4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5): created successfully Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bbf433-4065-42cc-b83b-ff8da1d72ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Flow 'volume_create_manager' (023aadc5-9e65-48b9-99f1-cc9c31122c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:20 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7808516b-f848-43dd-bf83-5a91c023f430 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created volume successfully. Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Creating offline snapshot e8c128ae-eb23-41e3-a147-22e779173bbe of volume cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee0e45-f9f8-4086-9261-7eccc825b153]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:20 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:20 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-39ca6923-e91e-4f93-844f-89296b3cc0a7-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-39ca6923-e91e-4f93-844f-89296b3cc0a7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-quobyte-39ca6923-e91e-4f93-844f-89296b3cc0a7" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-39ca6923-e91e-4f93-844f-89296b3cc0a7" acquired by "delete_volume" :: waited 0.020s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff795f-6c0b-40cd-b22c-4fed61b14528]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:20 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 Apr 02 20:04:20 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:20 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:20 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:20 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe 1G Apr 02 20:04:20 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:21 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7" returned: 0 in 0.496s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:21 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7 Apr 02 20:04:21 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0d360d-d04b-458a-969e-a2e7203577d2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:21 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe 1G" returned: 0 in 0.532s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:21 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:21 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:21 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 Apr 02 20:04:21 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:21 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-39ca6923-e91e-4f93-844f-89296b3cc0a7" returned: 0 in 0.509s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-39ca6923-e91e-4f93-844f-89296b3cc0a7" released by "delete_volume" :: held 1.027s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Created reservations ['154b35fc-5ec7-4f89-9cb7-d95171e47a32', '92459ac1-ae01-4125-a2f7-08b142bd57de', 'e324153c-c9c1-4fc2-b001-9af0627c0c9d', '54ab56ee-8bc5-400a-9615-56938ecb5557'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:21 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:21 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:21 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" returned: 0 in 0.528s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:21 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:22 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5 Apr 02 20:04:22 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:22 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.595s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:22 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe is being set with open permissions: ugo+rw Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:22 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:22 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:22 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Deleted volume successfully. Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-03b96799-b722-4459-93a2-dd77415c0e50 tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-39ca6923-e91e-4f93-844f-89296b3cc0a7-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:22 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" returned: 0 in 0.440s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5" released by "delete_volume" :: held 1.005s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['5de77e11-095d-4ee3-b5e0-a3177aaf472a', '6b29bfe8-dd2b-4fc2-9116-4eddc0763c00', '9782dccd-759a-413b-a1d5-d38213ca1709', '8eb2cf32-d23a-4f62-a06b-0fba68d1db47'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:22 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:22 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:22 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.500s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:22 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info Apr 02 20:04:22 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "cinder-quobyte-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711ab2f-b459-4c99-adad-d9f640af81bc]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:22 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 Apr 02 20:04:22 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:22 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:22 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:22 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-db8c0dcd-d39f-4bb8-bf10-4515d86164ce tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-4a5b5fc1-d95b-4eff-9cd0-83bf4a711fb5-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:23 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info" returned: 0 in 0.430s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:23 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info is being set with open permissions: ugo+rw Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:23 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info Apr 02 20:04:23 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:23 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:23 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161 Apr 02 20:04:23 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:23 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.info" returned: 0 in 0.409s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-169858694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fcbb0b-78d2-4007-a6fb-9d56a2d14662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e333fd76a60d4323b4aaf1d852319cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:20Z,use_quota=True,user_id='088c937bdc2640d49f4bfd39f436f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Creating volume 01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:23 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:23 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 1073741824 Apr 02 20:04:23 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:23 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-770091a8-989c-4d15-af0b-bd05894aae50 tempest-VolumeDependencyTests-1616403581 None] Create snapshot completed successfully Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-16943130-8d17-4c92-8627-33a4fbb6cc56-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-16943130-8d17-4c92-8627-33a4fbb6cc56-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-16943130-8d17-4c92-8627-33a4fbb6cc56" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-16943130-8d17-4c92-8627-33a4fbb6cc56" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a0ecff-3a2a-4929-ba5f-8ae6c8929876]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:23 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 Apr 02 20:04:23 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:23 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" returned: 0 in 0.415s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-quobyte-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161" released by "delete_volume" :: held 0.900s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Created reservations ['5ec3b40a-a0c9-4ce2-aeb3-caf58238ac7c', '7add9751-0a80-4fd6-a79c-825930ce0a13', '9147e456-2d7a-4509-b691-50d261a04b1d', 'a942be5e-9aac-4532-b73d-d262edfb647f'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:23 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:23 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:23 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:24 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 1073741824" returned: 0 in 0.551s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:24 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:24 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:24 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56" returned: 0 in 0.661s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:24 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56 Apr 02 20:04:24 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:24 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.609s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Deleted volume successfully. Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-58699a04-e0cf-40e4-ae16-1dbf74fecbcf tempest-CreateVolumesFromImageTest-152246863 None] Lock "cinder-e6b3f79a-9fb7-47d8-8f57-ca55ed8c4161-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (3058ecbf-50ae-4057-8a77-0c9ea2140dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7545e4-aa60-486a-9bfb-dd96ad86782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7545e4-aa60-486a-9bfb-dd96ad86782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1589721280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac70e62-cdf6-4865-8fe9-eaaef8b6421f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8c128ae-eb23-41e3-a147-22e779173bbe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:24Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eff84e-117b-41a9-91b3-ee4823fdfc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eff84e-117b-41a9-91b3-ee4823fdfc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf68ca3-f136-40b6-8580-a40eb1609ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf68ca3-f136-40b6-8580-a40eb1609ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bac70e62-cdf6-4865-8fe9-eaaef8b6421f', 'volume_name': 'volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f', 'volume_size': 1, 'snapshot_id': 'e8c128ae-eb23-41e3-a147-22e779173bbe'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9ec966-4acf-48c2-80e7-f51b29f793fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9ec966-4acf-48c2-80e7-f51b29f793fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfcf14-2699-4493-86fc-ab1566ce30e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Volume bac70e62-cdf6-4865-8fe9-eaaef8b6421f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f', 'volume_size': 1, 'snapshot_id': 'e8c128ae-eb23-41e3-a147-22e779173bbe'} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:24 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.696s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.117s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Creating volume bac70e62-cdf6-4865-8fe9-eaaef8b6421f from snapshot e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6273f68c-2d43-436d-819b-f798a0c79df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6daac71-16bc-4265-b462-7b979202d647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:24 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Volume volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 (01fcbb0b-78d2-4007-a6fb-9d56a2d14662): created successfully Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6daac71-16bc-4265-b462-7b979202d647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Flow 'volume_create_manager' (b766421c-5716-4d79-a3cd-4aaf580fef6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:24 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] snapshot: e8c128ae-eb23-41e3-a147-22e779173bbe, volume: bac70e62-cdf6-4865-8fe9-eaaef8b6421f, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-16943130-8d17-4c92-8627-33a4fbb6cc56" returned: 0 in 0.515s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:24 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3b715216-2f02-4153-8031-7cd4630dd6b6 tempest-SnapshotDependencyTests-18176957 None] Created volume successfully. Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-16943130-8d17-4c92-8627-33a4fbb6cc56" released by "delete_volume" :: held 1.204s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9836bd-a94b-4438-bb0a-a2c2375af5e6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['1a398158-3a01-45cb-8a8b-223bd89fb2ef', '719ae0c4-7d94-4219-a322-8e7ef6b5da10', '5f7ed9b9-c609-41ad-94d8-6ca4d3278626', 'c4b7e362-2465-4396-ac42-738d37899fc7'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:24 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:24 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:24 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:24 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:24 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:25 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.431s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:25 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=129,cinder:UPDATE=197,cinder:INSERT=47,cinder:DELETE=21 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:04:25 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-417aa60c-f1a6-4abf-8ecb-f6adf41e58d0 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-16943130-8d17-4c92-8627-33a4fbb6cc56-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.532s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f0b0a2-567a-40a0-b4fa-a22ffe29bf85]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:25 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:25 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-7481858c-195d-4a68-9c0a-c98876e4e562-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-7481858c-195d-4a68-9c0a-c98876e4e562-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:SELECT=150,cinder:INSERT=44,cinder:UPDATE=196,cinder:DELETE=17 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:04:25 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.509s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-7481858c-195d-4a68-9c0a-c98876e4e562" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-7481858c-195d-4a68-9c0a-c98876e4e562" acquired by "delete_volume" :: waited 0.056s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:25 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f Apr 02 20:04:25 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71a8ad-e269-4e2f-bc27-dde6e7cd8ac3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:25 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (9e097df9-3403-4b60-bc68-60f981381a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa4de82-a014-4771-b082-c31779ecd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa4de82-a014-4771-b082-c31779ecd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861161674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0af2cdc-4484-488d-914e-77f056e14f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:26Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d73d9a0-1839-441c-8099-1c67235deecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d73d9a0-1839-441c-8099-1c67235deecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48162ab-e7f6-4218-80c5-443c235623cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48162ab-e7f6-4218-80c5-443c235623cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0af2cdc-4484-488d-914e-77f056e14f28', 'volume_name': 'volume-c0af2cdc-4484-488d-914e-77f056e14f28', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2c223a-afc6-40ae-a006-93f3cecf0aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2c223a-afc6-40ae-a006-93f3cecf0aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5473fc4f-00a0-42b5-86b2-447680b3e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:26 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 Apr 02 20:04:26 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:26 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume c0af2cdc-4484-488d-914e-77f056e14f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0af2cdc-4484-488d-914e-77f056e14f28', 'volume_size': 1} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:26 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562" returned: 0 in 0.811s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:26 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:26 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562 Apr 02 20:04:26 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:27 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7481858c-195d-4a68-9c0a-c98876e4e562" returned: 0 in 0.846s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-7481858c-195d-4a68-9c0a-c98876e4e562" released by "delete_volume" :: held 1.707s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['fd2a1fff-7702-4f41-8f20-ae85e7dba3be', 'a350fac3-36ac-4314-81ca-cbe6ea3b7db8', 'b4a1cb13-7272-4131-a897-7110640c6929', '78df9bac-0337-4c91-8728-fc88a8a541e1'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:27 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:27 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:27 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-c9f22284-fa11-4424-a6b9-5ffac09503e3-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:28 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" returned: 0 in 2.214s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-c9f22284-fa11-4424-a6b9-5ffac09503e3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c75b44b-6c6e-44a0-abcf-1281aed7f731]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-c9f22284-fa11-4424-a6b9-5ffac09503e3" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-c9f22284-fa11-4424-a6b9-5ffac09503e3" acquired by "delete_volume" :: waited 0.016s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[862511e3-d639-4e5a-9035-272507bef9e3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:28 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:28 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:28 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 Apr 02 20:04:28 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:28 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.583s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:28 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad019de3-f769-4672-9b98-e19e6c60ad2e tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-7481858c-195d-4a68-9c0a-c98876e4e562-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:28 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3" returned: 0 in 0.451s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:28 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3 Apr 02 20:04:28 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:28 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.691s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:04:28 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Converted 1024.00 MB image at 462.27 MB/s Apr 02 20:04:28 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f is being set with open permissions: ugo+rw Apr 02 20:04:28 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:28 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f Apr 02 20:04:28 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c9f22284-fa11-4424-a6b9-5ffac09503e3" returned: 0 in 0.394s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-c9f22284-fa11-4424-a6b9-5ffac09503e3" released by "delete_volume" :: held 0.874s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['83ee34a2-ec49-4dc5-8289-219e1ed4b63c', '51701355-2c1f-42e9-9356-3f9c387c1a21', '745afe54-e02c-412d-a7cc-5cdda2e708b7', '1f7c6749-1d3f-4eda-a463-b075967e40b8'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:29 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:29 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-af88c330-1c46-405f-bbc4-1c5dec8456ec-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:29 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" returned: 0 in 0.420s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" released by "_copy_volume_from_snapshot" :: held 4.466s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-af88c330-1c46-405f-bbc4-1c5dec8456ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" released by "_create_volume_from_snapshot" :: held 4.520s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.529s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.215s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861161674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0af2cdc-4484-488d-914e-77f056e14f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:26Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:29 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:29 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 1073741824 Apr 02 20:04:29 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfcf14-2699-4493-86fc-ab1566ce30e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f', 'volume_size': 1, 'snapshot_id': 'e8c128ae-eb23-41e3-a147-22e779173bbe'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b087ae55-499d-4e4c-a617-69d330a3e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-af88c330-1c46-405f-bbc4-1c5dec8456ec" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:29 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Volume volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f (bac70e62-cdf6-4865-8fe9-eaaef8b6421f): created successfully Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b087ae55-499d-4e4c-a617-69d330a3e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (3058ecbf-50ae-4057-8a77-0c9ea2140dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-af88c330-1c46-405f-bbc4-1c5dec8456ec" acquired by "delete_volume" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-d85e24c7-5dc4-42ab-a87d-5d552c0ecc56 tempest-VolumeDependencyTests-1616403581 None] Created volume successfully. Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fba97f-f061-4be1-83ae-0de800c1e7f0]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:29 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec Apr 02 20:04:29 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:29 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bf01b0b4-0657-45a4-87f6-e84a2a30f6fe tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-c9f22284-fa11-4424-a6b9-5ffac09503e3-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:29 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 1073741824" returned: 0 in 0.459s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:29 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 Apr 02 20:04:29 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-e8c128ae-eb23-41e3-a147-22e779173bbe-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-e8c128ae-eb23-41e3-a147-22e779173bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:29 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:29 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec Apr 02 20:04:29 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Deleting offline snapshot e8c128ae-eb23-41e3-a147-22e779173bbe of volume cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] snapshot_file for this snap is: volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[932aa01a-40b2-4b06-97c1-1f53944b4826]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:29 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:30 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:30 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28" returned: 0 in 0.435s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.137s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Creating offline snapshot aa975505-b6b8-48ea-bca8-847516f7955e of volume 01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5473fc4f-00a0-42b5-86b2-447680b3e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0af2cdc-4484-488d-914e-77f056e14f28', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897d88bd-d840-48b0-9d57-cab3d2c04e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64880b1-9d14-468f-8c83-820b0046f7c3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-c0af2cdc-4484-488d-914e-77f056e14f28 (c0af2cdc-4484-488d-914e-77f056e14f28): created successfully Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897d88bd-d840-48b0-9d57-cab3d2c04e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (9e097df9-3403-4b60-bc68-60f981381a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ca77a0c8-4f48-4e1b-a28c-bb024391d404 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:30 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-af88c330-1c46-405f-bbc4-1c5dec8456ec" returned: 0 in 0.427s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-af88c330-1c46-405f-bbc4-1c5dec8456ec" released by "delete_volume" :: held 0.944s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:30 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:30 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['9e6983e2-67d3-48f1-9b24-5a76f5711770', '8b66cfe2-83ed-46ee-8a19-13ae6983fd7a', '215b6866-3eeb-4f07-9926-519b49d8d441', '75a0ebe2-58c4-48c0-a717-bfab5028ec74'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.539s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:30 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:30 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ce0d9-5461-4499-a8b9-d20f4119f43e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:30 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:30 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:30 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e 1G Apr 02 20:04:30 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:30 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:30 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-459d38f5-03a0-44a4-bb5a-d3ca37b91323 tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-af88c330-1c46-405f-bbc4-1c5dec8456ec-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:30 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.481s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:30 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:30 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:30 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:31 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e 1G" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:31 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:31 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:31 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-13ac4082-41c7-413b-9df1-06549d9debcb-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:31 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe Apr 02 20:04:31 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-13ac4082-41c7-413b-9df1-06549d9debcb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "cinder-quobyte-13ac4082-41c7-413b-9df1-06549d9debcb" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-13ac4082-41c7-413b-9df1-06549d9debcb" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[5404c8ec-b776-42b7-9db6-6dcaac1a2cdd]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:31 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb Apr 02 20:04:31 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:31 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.437s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:31 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e is being set with open permissions: ugo+rw Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:31 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:31 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:31 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b.e8c128ae-eb23-41e3-a147-22e779173bbe" returned: 0 in 0.431s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-e8c128ae-eb23-41e3-a147-22e779173bbe" released by "_delete_snapshot" :: held 1.959s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" released by "delete_snapshot" :: held 1.974s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Created reservations ['6d719424-1fa6-4c13-9dbe-10028218446b', 'f0155465-e570-49ca-a583-b45e1a97f8d1', '33288786-0e0b-495b-95cf-cf40e7b59340', 'aa65fc2f-ee8c-4cdd-8026-a8ef60e9df7b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:31 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Delete snapshot completed successfully. Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-5a64bab0-fc75-41a5-afc9-c9d2cb4fb9c3 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-e8c128ae-eb23-41e3-a147-22e779173bbe-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:31 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:31 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-cfe703c9-6367-4fe3-bdca-402cf0bd214b-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:32 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb Apr 02 20:04:32 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-cfe703c9-6367-4fe3-bdca-402cf0bd214b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" acquired by "delete_volume" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b14adf-cf02-4dd1-a8c4-f2acb4bb652b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.482s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:32 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:32 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info Apr 02 20:04:32 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-13ac4082-41c7-413b-9df1-06549d9debcb" returned: 0 in 0.392s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-quobyte-13ac4082-41c7-413b-9df1-06549d9debcb" released by "delete_volume" :: held 0.904s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Created reservations ['d254f6a0-cd41-4a10-bfe8-9831a0238fc1', 'd5c2385d-09b8-45fd-9a1f-7924177e73f7', 'fca4ca1f-fdd4-4dde-ba32-6e61a6ccf5b7', 'e2ad674d-8d3b-4235-9df8-92aa42092a2e'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:32 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.510s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b Apr 02 20:04:32 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info" returned: 0 in 0.502s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:32 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info is being set with open permissions: ugo+rw Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:32 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info Apr 02 20:04:32 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:32 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:32 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Deleted volume successfully. Apr 02 20:04:32 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-e3a62fb2-a3c1-4676-a9c5-6642b3cc57eb tempest-CreateVolumesFromSourceVolumeTest-699402737 None] Lock "cinder-13ac4082-41c7-413b-9df1-06549d9debcb-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:33 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-cfe703c9-6367-4fe3-bdca-402cf0bd214b" returned: 0 in 0.440s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-cfe703c9-6367-4fe3-bdca-402cf0bd214b" released by "delete_volume" :: held 0.976s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Created reservations ['d785ad23-f109-43d4-a104-0d161de5e19a', 'c12f2b7d-58fe-4291-a9af-fa8cee32199b', 'bc730e4b-5cea-4849-9098-55fd9215d3e0', '5ea3defd-e916-4910-a3bc-39956110c338'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:33 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.info" returned: 0 in 0.461s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.922s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.615s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-7efed726-8198-4405-b4e0-689cd7aa6cfd tempest-SnapshotDependencyTests-18176957 None] Create snapshot completed successfully Apr 02 20:04:33 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:33 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating offline snapshot 1afc10fd-db65-4a0b-82eb-6fc1992587cd of volume c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6c83a-ff66-4daf-b5d6-2b509b8d8041]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:33 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 Apr 02 20:04:33 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Flow 'volume_create_manager' (57e6eca2-571c-498d-8641-5b2f110287b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:33 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7408307d-03f3-4c0f-9cb0-8a7ee113fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.559s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:33 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Deleted volume successfully. Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7408307d-03f3-4c0f-9cb0-8a7ee113fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a909807-6aa5-4643-8a87-dada3a743978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e333fd76a60d4323b4aaf1d852319cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa975505-b6b8-48ea-bca8-847516f7955e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:34Z,use_quota=True,user_id='088c937bdc2640d49f4bfd39f436f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7bcc0e-3637-4c0d-8cd9-545f8f622a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7bcc0e-3637-4c0d-8cd9-545f8f622a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b7e80e-3b37-4378-a108-d57c88be764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b7e80e-3b37-4378-a108-d57c88be764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a909807-6aa5-4643-8a87-dada3a743978', 'volume_name': 'volume-3a909807-6aa5-4643-8a87-dada3a743978', 'volume_size': 1, 'snapshot_id': 'aa975505-b6b8-48ea-bca8-847516f7955e'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47f2686-cdf0-48e2-8335-b7fb6dc67777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47f2686-cdf0-48e2-8335-b7fb6dc67777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b520a0-6f19-4ed1-bfdb-0cb3300d9d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:33 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Volume 3a909807-6aa5-4643-8a87-dada3a743978: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a909807-6aa5-4643-8a87-dada3a743978', 'volume_size': 1, 'snapshot_id': 'aa975505-b6b8-48ea-bca8-847516f7955e'} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-beb924f3-4f88-4ef9-88a0-b7618a8450ef tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-cfe703c9-6367-4fe3-bdca-402cf0bd214b-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:33 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28" returned: 0 in 0.597s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:33 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:33 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd 1G Apr 02 20:04:33 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:34 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd 1G" returned: 0 in 0.527s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0af2cdc-4484-488d-914e-77f056e14f28 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:34 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0af2cdc-4484-488d-914e-77f056e14f28 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd Apr 02 20:04:34 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Flow 'volume_create_manager' (80ccd0c4-9bed-46ca-ad88-d9c640907d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663f5dc1-2d6d-42fe-95ec-bac3485b98d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663f5dc1-2d6d-42fe-95ec-bac3485b98d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfe6f98-c4f6-4000-a65b-ffda2cdf399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8914294978804683a8e28145624fa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:34Z,use_quota=True,user_id='ff580c696d234ebc8095b44da98a803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9f9e23-8496-4d5f-ae93-788183fd41ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9f9e23-8496-4d5f-ae93-788183fd41ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3a468d-a06e-4e97-925c-bbe5705b363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3a468d-a06e-4e97-925c-bbe5705b363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cfe6f98-c4f6-4000-a65b-ffda2cdf399b', 'volume_name': 'volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20011238-958b-4c1c-ad70-05799954a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20011238-958b-4c1c-ad70-05799954a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6858e688-cf32-473e-b153-4736a9968403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Volume 0cfe6f98-c4f6-4000-a65b-ffda2cdf399b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b', 'volume_size': 1} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (95ae6c5c-fd85-49df-8dd4-c9d921d0db7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66fb99a-01bd-4fd0-99a2-60c89f20c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66fb99a-01bd-4fd0-99a2-60c89f20c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998133639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c34f847-fa3f-4196-91e0-4b6635fa6e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:35Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155a3bd8-254d-49c6-8cde-184837d345bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155a3bd8-254d-49c6-8cde-184837d345bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48572a5-097c-4b6a-85d3-4c781c7c402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48572a5-097c-4b6a-85d3-4c781c7c402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'volume_name': 'volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff09191-06bc-48de-b3ad-5448eb911253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff09191-06bc-48de-b3ad-5448eb911253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2745e7-6a59-4d8d-ba9c-8a8b1bf5b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:34 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Volume 7c34f847-fa3f-4196-91e0-4b6635fa6e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'volume_size': 1} Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:34 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0af2cdc-4484-488d-914e-77f056e14f28 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd" returned: 0 in 0.464s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:34 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd is being set with open permissions: ugo+rw Apr 02 20:04:34 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:34 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd Apr 02 20:04:34 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:35 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd" returned: 0 in 0.405s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:35 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info Apr 02 20:04:35 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:35 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:35 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info is being set with open permissions: ugo+rw Apr 02 20:04:35 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:35 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info Apr 02 20:04:35 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:36 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.info" returned: 0 in 0.399s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.283s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e-3a909807-6aa5-4643-8a87-dada3a743978" by "_create_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e-3a909807-6aa5-4643-8a87-dada3a743978" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Creating volume 3a909807-6aa5-4643-8a87-dada3a743978 from snapshot aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:36 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-735f5b94-9162-4f8b-a924-61dfb907abd3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Create snapshot completed successfully Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] snapshot: aa975505-b6b8-48ea-bca8-847516f7955e, volume: 3a909807-6aa5-4643-8a87-dada3a743978, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1843911-16ad-49ee-bc25-7205bc671ad6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:36 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:36 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:36 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.490s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a17368-a216-4d4f-a94a-98bb04ddf6c4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:36 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:36 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:36 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (9b4d9074-464b-4a1f-8fef-445bafddeba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e734baa0-ca19-433d-bf8d-c3ecc934c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e734baa0-ca19-433d-bf8d-c3ecc934c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375977036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f9b8c-7a3f-41ea-860d-fb10d7b462c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf60857-7d7a-42bd-877e-80e9a7c27763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf60857-7d7a-42bd-877e-80e9a7c27763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93de07eb-d147-475c-ae60-0e03bd2e09b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93de07eb-d147-475c-ae60-0e03bd2e09b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842f9b8c-7a3f-41ea-860d-fb10d7b462c5', 'volume_name': 'volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a3c99f-f4f7-4f22-82fc-748d3f798fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a3c99f-f4f7-4f22-82fc-748d3f798fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7954b571-948b-480a-b7e8-613237bfad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume 842f9b8c-7a3f-41ea-860d-fb10d7b462c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5', 'volume_size': 1} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:37 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:37 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 Apr 02 20:04:37 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (3ad96595-c27c-4c45-aaa1-59c11958bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af32607d-9cbb-47eb-a733-73f926179bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af32607d-9cbb-47eb-a733-73f926179bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937463993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd1058f-88c6-4ced-9721-4b4c86eec8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06c6f0-ba7b-4959-96ee-b193b60923c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06c6f0-ba7b-4959-96ee-b193b60923c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5106a0d-136f-49ab-b331-3417dbecf2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5106a0d-136f-49ab-b331-3417dbecf2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd1058f-88c6-4ced-9721-4b4c86eec8be', 'volume_name': 'volume-edd1058f-88c6-4ced-9721-4b4c86eec8be', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b3556-24cb-44d5-9952-e1c1ac19b606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b3556-24cb-44d5-9952-e1c1ac19b606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a82b08-fa97-4f81-ab1c-178f769f4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume edd1058f-88c6-4ced-9721-4b4c86eec8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd1058f-88c6-4ced-9721-4b4c86eec8be', 'volume_size': 1} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (b28aefbc-7663-4059-9a74-e84f41bb0650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9112c9-5119-483c-85cb-74b4fc4c3361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9112c9-5119-483c-85cb-74b4fc4c3361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015821742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaf0187-0c5a-48a6-97de-5f887f1c4cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae45cac3-874b-45e3-8293-c3353e45a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae45cac3-874b-45e3-8293-c3353e45a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cd66d0-250d-406a-a464-aa868d7c4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cd66d0-250d-406a-a464-aa868d7c4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eaf0187-0c5a-48a6-97de-5f887f1c4cfa', 'volume_name': 'volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fde774-39fc-4c9d-a725-23a1ad76f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fde774-39fc-4c9d-a725-23a1ad76f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15239dac-4a55-4e9a-92de-60b7b4da97b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume 7eaf0187-0c5a-48a6-97de-5f887f1c4cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa', 'volume_size': 1} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (6f184246-1e38-4382-8982-639c529829f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5cf9f5-8f9a-4b48-bc57-8c3f2e90d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5cf9f5-8f9a-4b48-bc57-8c3f2e90d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381989666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2699c34b-8f48-472c-92cd-686493c5a910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:38Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b8417-3ae8-4def-994d-00253ad0d597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b8417-3ae8-4def-994d-00253ad0d597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81594f80-a4d7-404a-acc9-b8afc5ea4323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81594f80-a4d7-404a-acc9-b8afc5ea4323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2699c34b-8f48-472c-92cd-686493c5a910', 'volume_name': 'volume-2699c34b-8f48-472c-92cd-686493c5a910', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383d8a2d-4203-4eb0-a6f1-ffa8c7c624c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383d8a2d-4203-4eb0-a6f1-ffa8c7c624c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4723adfd-a291-41f5-9d4a-789b3bf2140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:37 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume 2699c34b-8f48-472c-92cd-686493c5a910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2699c34b-8f48-472c-92cd-686493c5a910', 'volume_size': 1} Apr 02 20:04:37 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (b4f010e4-db20-43d5-a1e5-1084e45a4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f341cef-20b1-4376-8ce0-7ad07853d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f341cef-20b1-4376-8ce0-7ad07853d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373518322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328baec-7eb6-48b5-b848-91bc9c0bc0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:38Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e79921-5cf1-46bb-aefa-7faaeb9f971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e79921-5cf1-46bb-aefa-7faaeb9f971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f628924-38f0-4e65-a011-d3334b9d9a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f628924-38f0-4e65-a011-d3334b9d9a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e328baec-7eb6-48b5-b848-91bc9c0bc0b6', 'volume_name': 'volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357ea50d-6880-427a-aa91-3b4817b1912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357ea50d-6880-427a-aa91-3b4817b1912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48815923-f331-45ba-953f-9edcdb305c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:38 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume e328baec-7eb6-48b5-b848-91bc9c0bc0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6', 'volume_size': 1} Apr 02 20:04:38 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:39 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978" returned: 0 in 2.254s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27393f8-fb2c-4adb-8cc1-a66f745a84fc]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:39 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:39 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:39 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.580s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:04:39 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Converted 1024.00 MB image at 454.16 MB/s Apr 02 20:04:39 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 is being set with open permissions: ugo+rw Apr 02 20:04:39 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:39 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 Apr 02 20:04:39 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:40 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" released by "_copy_volume_from_snapshot" :: held 4.262s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e-3a909807-6aa5-4643-8a87-dada3a743978" released by "_create_volume_from_snapshot" :: held 4.286s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.309s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.849s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfe6f98-c4f6-4000-a65b-ffda2cdf399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8914294978804683a8e28145624fa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:34Z,use_quota=True,user_id='ff580c696d234ebc8095b44da98a803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Creating volume 0cfe6f98-c4f6-4000-a65b-ffda2cdf399b {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:40 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:40 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b 1073741824 Apr 02 20:04:40 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b520a0-6f19-4ed1-bfdb-0cb3300d9d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a909807-6aa5-4643-8a87-dada3a743978', 'volume_size': 1, 'snapshot_id': 'aa975505-b6b8-48ea-bca8-847516f7955e'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e2651f-1a0f-4bb3-82ed-6067a75a13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:40 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Volume volume-3a909807-6aa5-4643-8a87-dada3a743978 (3a909807-6aa5-4643-8a87-dada3a743978): created successfully Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e2651f-1a0f-4bb3-82ed-6067a75a13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Flow 'volume_create_manager' (57e6eca2-571c-498d-8641-5b2f110287b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:40 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-68b7d621-5ece-49fc-9a68-605707d652c0 tempest-SnapshotDependencyTests-18176957 None] Created volume successfully. Apr 02 20:04:40 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b 1073741824" returned: 0 in 0.486s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:40 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:40 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b Apr 02 20:04:40 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-aa975505-b6b8-48ea-bca8-847516f7955e-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-aa975505-b6b8-48ea-bca8-847516f7955e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Deleting offline snapshot aa975505-b6b8-48ea-bca8-847516f7955e of volume 01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] snapshot_file for this snap is: volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419fb85-79d5-432e-8a94-c2df28f380a3]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:41 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" returned: 0 in 0.412s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.709s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998133639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c34f847-fa3f-4196-91e0-4b6635fa6e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:35Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Creating volume 7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:41 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6858e688-cf32-473e-b153-4736a9968403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:41 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d 1073741824 Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff3ff0-b0a5-4668-96ca-6a677d6abcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:41 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:41 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:41 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:41 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Volume volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b (0cfe6f98-c4f6-4000-a65b-ffda2cdf399b): created successfully Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ff3ff0-b0a5-4668-96ca-6a677d6abcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Flow 'volume_create_manager' (80ccd0c4-9bed-46ca-ad88-d9c640907d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:41 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-e306c5d5-e24a-4d11-af66-403083fde4c6 tempest-CinderUnicodeTest-1914892328 None] Created volume successfully. Apr 02 20:04:41 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.486s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[7147cf19-ff1d-41d0-9c8e-15ba35096e8e]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:41 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d 1073741824" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:41 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:41 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:41 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:41 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:41 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Flow 'volume_create_manager' (3de5a276-98d3-43c4-b13f-af14a420a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b7c97e-db0e-4dd1-9773-03fd7061cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b7c97e-db0e-4dd1-9773-03fd7061cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2012670326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24131018-8693-4da8-ba3d-329a9da0cb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8914294978804683a8e28145624fa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:42Z,use_quota=True,user_id='ff580c696d234ebc8095b44da98a803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f0f73-bf51-48fb-90b0-2bb052f74441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f0f73-bf51-48fb-90b0-2bb052f74441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05187ef5-7418-4e31-8587-820c2450ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05187ef5-7418-4e31-8587-820c2450ca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24131018-8693-4da8-ba3d-329a9da0cb86', 'volume_name': 'volume-24131018-8693-4da8-ba3d-329a9da0cb86', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0cef97-13f6-416d-bb97-d62198ae43aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0cef97-13f6-416d-bb97-d62198ae43aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f06e1f-d32c-4777-b350-d27636ef63c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Volume 24131018-8693-4da8-ba3d-329a9da0cb86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24131018-8693-4da8-ba3d-329a9da0cb86', 'volume_size': 1} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:42 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.487s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.259s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375977036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f9b8c-7a3f-41ea-860d-fb10d7b462c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume 842f9b8c-7a3f-41ea-860d-fb10d7b462c5 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:42 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:42 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.574s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:42 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 1073741824 Apr 02 20:04:42 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2745e7-6a59-4d8d-ba9c-8a8b1bf5b441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51db3a-3617-4013-b56d-883e6a687b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:42 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:42 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:42 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Volume volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d (7c34f847-fa3f-4196-91e0-4b6635fa6e0d): created successfully Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f51db3a-3617-4013-b56d-883e6a687b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (95ae6c5c-fd85-49df-8dd4-c9d921d0db7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:42 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-51e9e7ce-63c4-4ded-8530-450d4cba4918 tempest-VolumeDependencyTests-1616403581 None] Created volume successfully. Apr 02 20:04:42 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:42 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e Apr 02 20:04:42 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:42 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 1073741824" returned: 0 in 0.479s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:42 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:42 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 Apr 02 20:04:42 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:43 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662.aa975505-b6b8-48ea-bca8-847516f7955e" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82597) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-aa975505-b6b8-48ea-bca8-847516f7955e" released by "_delete_snapshot" :: held 2.029s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (cd2b6bbd-04d5-44fe-b0fa-986730bb32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3446b1-d0d1-440e-b571-cda06b32eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3446b1-d0d1-440e-b571-cda06b32eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1060209229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a54887b-f0f2-488c-82f9-d24e2a1e0577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cb1e31b1b74af6bc16110f418295ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7c34f847-fa3f-4196-91e0-4b6635fa6e0d,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:43Z,use_quota=True,user_id='0edde70628aa42ebaf34a99379265c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae81b7-c73e-49c8-b098-537be54ff365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae81b7-c73e-49c8-b098-537be54ff365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3ccabf-7dc4-4d1f-9f4b-46eb805f793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" returned: 0 in 0.507s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" released by "delete_snapshot" :: held 2.095s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.050s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937463993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd1058f-88c6-4ced-9721-4b4c86eec8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume edd1058f-88c6-4ced-9721-4b4c86eec8be {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:43 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:43 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be 1073741824 Apr 02 20:04:43 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7954b571-948b-480a-b7e8-613237bfad71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c935d-ebf1-484c-bb57-5b3d590cf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3ccabf-7dc4-4d1f-9f4b-46eb805f793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5a54887b-f0f2-488c-82f9-d24e2a1e0577', 'volume_name': 'volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577', 'volume_size': 1, 'source_volid': '7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184a0813-76f0-48f1-8b3a-13b548cd70fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184a0813-76f0-48f1-8b3a-13b548cd70fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d295b90-fe69-4d78-ae94-b30e6049fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:43 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Volume 5a54887b-f0f2-488c-82f9-d24e2a1e0577: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577', 'volume_size': 1, 'source_volid': '7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'source_volstatus': 'available'} Apr 02 20:04:43 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 (842f9b8c-7a3f-41ea-860d-fb10d7b462c5): created successfully Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c935d-ebf1-484c-bb57-5b3d590cf496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (9b4d9074-464b-4a1f-8fef-445bafddeba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-bff1b292-e869-4fca-92d4-bcdaab687526 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Created reservations ['3506292a-3082-437c-8519-512eccdc95b4', '87acc27a-3ceb-4dc9-980e-4b8231c19bb9', '4e87913f-942b-4843-8419-b372fc848678', '1af486e5-68f5-424d-9c99-e5e384c5a6d7'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:43 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Delete snapshot completed successfully. Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-3a8b6fac-28e7-457d-b3d2-470226e1914a tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-aa975505-b6b8-48ea-bca8-847516f7955e-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:43 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be 1073741824" returned: 0 in 0.492s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:43 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:43 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be Apr 02 20:04:43 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:44 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be" returned: 0 in 0.407s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.792s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015821742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaf0187-0c5a-48a6-97de-5f887f1c4cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:37Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume 7eaf0187-0c5a-48a6-97de-5f887f1c4cfa {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:44 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a82b08-fa97-4f81-ab1c-178f769f4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd1058f-88c6-4ced-9721-4b4c86eec8be', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ccb1e9-53cc-4139-95b4-59235ce3da8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:44 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa 1073741824 Apr 02 20:04:44 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:44 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-edd1058f-88c6-4ced-9721-4b4c86eec8be (edd1058f-88c6-4ced-9721-4b4c86eec8be): created successfully Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ccb1e9-53cc-4139-95b4-59235ce3da8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (3ad96595-c27c-4c45-aaa1-59c11958bb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:44 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-37d0e01e-628b-4188-adc6-2cbb05a203ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-01fcbb0b-78d2-4007-a6fb-9d56a2d14662-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-01fcbb0b-78d2-4007-a6fb-9d56a2d14662-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ba218f-34fe-4f28-8cc4-03800b1a3c87]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:44 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:44 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:44 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa 1073741824" returned: 0 in 0.503s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:44 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa Apr 02 20:04:44 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:44 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.485s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:44 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:44 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662 Apr 02 20:04:44 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:45 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" returned: 0 in 0.409s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.340s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381989666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2699c34b-8f48-472c-92cd-686493c5a910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:38Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume 2699c34b-8f48-472c-92cd-686493c5a910 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:45 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15239dac-4a55-4e9a-92de-60b7b4da97b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:45 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 1073741824 Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac162180-4eee-419e-8207-0a37a58450a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:45 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:45 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa (7eaf0187-0c5a-48a6-97de-5f887f1c4cfa): created successfully Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac162180-4eee-419e-8207-0a37a58450a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (b28aefbc-7663-4059-9a74-e84f41bb0650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-86be38b8-b6cb-4b94-bf79-561d85359c80 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:45 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" returned: 0 in 0.414s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-01fcbb0b-78d2-4007-a6fb-9d56a2d14662" released by "delete_volume" :: held 0.941s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Created reservations ['aa778e4a-7de7-4c1e-bd53-1a7419cb5875', 'a1e91d47-c40c-427c-a39b-a003e29a4273', '986b38dd-939f-410c-9ed4-eb4f802dd6f0', '8886645d-47ed-4c70-9d5d-e40f10f08157'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:45 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:45 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-3a909807-6aa5-4643-8a87-dada3a743978-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-3a909807-6aa5-4643-8a87-dada3a743978-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1928251-97b1-475f-a39c-c95876b6ca86]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:45 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 Apr 02 20:04:45 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:45 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 1073741824" returned: 0 in 0.506s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:45 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 Apr 02 20:04:45 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:45 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.474s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:45 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Deleted volume successfully. Apr 02 20:04:45 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-94c015fa-0816-47ef-a68b-b842984f8097 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-01fcbb0b-78d2-4007-a6fb-9d56a2d14662-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:46 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978" returned: 0 in 0.536s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:46 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978 Apr 02 20:04:46 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:46 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910" returned: 0 in 0.423s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.681s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373518322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e328baec-7eb6-48b5-b848-91bc9c0bc0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f040043467d43e38e8cb4e4ba8b4b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:38Z,use_quota=True,user_id='d9cdff48c37f4382967aead9f01c4155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Creating volume e328baec-7eb6-48b5-b848-91bc9c0bc0b6 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:46 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4723adfd-a291-41f5-9d4a-789b3bf2140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2699c34b-8f48-472c-92cd-686493c5a910', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:46 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 1073741824 Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ef666f-7d51-4b66-92c8-4db76dc6fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:46 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:46 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-2699c34b-8f48-472c-92cd-686493c5a910 (2699c34b-8f48-472c-92cd-686493c5a910): created successfully Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ef666f-7d51-4b66-92c8-4db76dc6fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (6f184246-1e38-4382-8982-639c529829f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:46 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f4f81248-6b26-452a-badf-12a2223f95ba tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:46 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-3a909807-6aa5-4643-8a87-dada3a743978" returned: 0 in 0.416s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-quobyte-3a909807-6aa5-4643-8a87-dada3a743978" released by "delete_volume" :: held 0.977s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Created reservations ['0f42f3f6-def3-4a18-9b08-e00948d9e239', '955d56c4-8a03-49bc-9d4e-67c6c6329e58', 'be9a1bd8-06ee-46c2-b143-b1aee609cfc3', 'e1560708-6347-48e0-846a-cf7d6b58e771'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:46 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:46 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:46 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 1073741824" returned: 0 in 0.521s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:46 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:46 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 Apr 02 20:04:46 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:47 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.417s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Deleted volume successfully. Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-1f0328a4-5847-4f9f-b4a5-f8649fc96f12 tempest-SnapshotDependencyTests-18176957 None] Lock "cinder-3a909807-6aa5-4643-8a87-dada3a743978-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:47 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" returned: 0 in 0.430s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.923s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T18:04:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2012670326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24131018-8693-4da8-ba3d-329a9da0cb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8914294978804683a8e28145624fa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T18:04:42Z,use_quota=True,user_id='ff580c696d234ebc8095b44da98a803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ffc015d-0da6-49ff-af63-8d76eaef4930),volume_type_id=9ffc015d-0da6-49ff-af63-8d76eaef4930)}" {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Creating volume 24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Selected osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b as target Quobyte volume. {{(pid=82597) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 20:04:47 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] casted to osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 1073741824 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48815923-f331-45ba-953f-9edcdb305c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b794e2e-498b-4a65-a231-0aaf3d086d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:47 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 1073741824 Apr 02 20:04:47 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:47 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Volume volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 (e328baec-7eb6-48b5-b848-91bc9c0bc0b6): created successfully Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b794e2e-498b-4a65-a231-0aaf3d086d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Flow 'volume_create_manager' (b4f010e4-db20-43d5-a1e5-1084e45a4a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:47 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-28228e4d-079d-4d39-bdb2-ac3392ce3685 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created volume successfully. Apr 02 20:04:47 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 1073741824" returned: 0 in 0.483s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:47 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 Apr 02 20:04:47 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-e328baec-7eb6-48b5-b848-91bc9c0bc0b6-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-e328baec-7eb6-48b5-b848-91bc9c0bc0b6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916d06e-6ffc-469a-9b16-43bdeaa6afdc]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:47 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:48 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 Apr 02 20:04:48 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:48 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'} {{(pid=82597) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.706s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:48 devstack cinder-volume[82597]: INFO cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Cloning volume 7c34f847-fa3f-4196-91e0-4b6635fa6e0d to volume 5a54887b-f0f2-488c-82f9-d24e2a1e0577 Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f06e1f-d32c-4777-b350-d27636ef63c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24131018-8693-4da8-ba3d-329a9da0cb86', 'volume_size': 1}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055a3758-3ef8-4167-a03b-8d37066f50e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:48 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Volume volume-24131018-8693-4da8-ba3d-329a9da0cb86 (24131018-8693-4da8-ba3d-329a9da0cb86): created successfully Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055a3758-3ef8-4167-a03b-8d37066f50e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Flow 'volume_create_manager' (3de5a276-98d3-43c4-b13f-af14a420a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:48 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-1aaf6c7f-c753-4032-b0c9-e481783379b8 tempest-CinderUnicodeTest-1914892328 None] Created volume successfully. Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Creating offline snapshot 46dd314b-21cc-44ad-91f5-86106235c979 of volume 7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a350120b-9127-4e9b-93a1-7736d729280a]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:48 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:48 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:48 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" returned: 0 in 0.542s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:48 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6 Apr 02 20:04:48 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:48 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.603s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:48 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:48 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 1G Apr 02 20:04:48 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:49 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-e328baec-7eb6-48b5-b848-91bc9c0bc0b6" released by "delete_volume" :: held 1.052s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['36b6411e-2af8-4271-9917-2a06e9489aeb', 'dd01ae84-9078-427b-8b09-cbbe5498f819', '06eedea6-c9b3-4e1d-ad3d-a83ad6698547', '0ac048d7-a7db-4ef7-b2d0-0ec31171a33b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:49 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:49 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:49 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 1G" returned: 0 in 0.570s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:49 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:49 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:49 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.456s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:49 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-61838a73-77f0-4680-bd48-cd1bb2ec5a1f tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-e328baec-7eb6-48b5-b848-91bc9c0bc0b6-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:49 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.519s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:49 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 is being set with open permissions: ugo+rw Apr 02 20:04:49 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:49 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:49 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-2699c34b-8f48-472c-92cd-686493c5a910-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-2699c34b-8f48-472c-92cd-686493c5a910-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-2699c34b-8f48-472c-92cd-686493c5a910" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-2699c34b-8f48-472c-92cd-686493c5a910" acquired by "delete_volume" :: waited 0.015s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417e13e-4a3e-494e-8242-ad7ee407c4da]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:50 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 Apr 02 20:04:50 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:50 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.464s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:50 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info Apr 02 20:04:50 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:50 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910" returned: 0 in 0.534s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:50 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910 Apr 02 20:04:50 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:50 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info" returned: 0 in 0.479s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:50 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info is being set with open permissions: ugo+rw Apr 02 20:04:50 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:50 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info Apr 02 20:04:50 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:51 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-2699c34b-8f48-472c-92cd-686493c5a910" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-2699c34b-8f48-472c-92cd-686493c5a910" released by "delete_volume" :: held 1.007s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['6c643d81-0861-4d3f-abbd-007fa827b71a', 'c93a2553-089d-438f-9ae6-3ba242a3274d', '39d0e6b0-2365-46b4-bad8-8fbc0415277a', '492eceef-e986-4d66-a70a-0d4138d1a53b'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:51 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:51 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:51 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.info" returned: 0 in 0.480s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" by "_copy_volume_from_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] snapshot: 46dd314b-21cc-44ad-91f5-86106235c979, volume: 5a54887b-f0f2-488c-82f9-d24e2a1e0577, {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa0b6f-4a41-4bf8-a0c4-621a6dc397f2]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:51 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:51 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:51 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.453s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:51 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c5792fa6-8fca-4759-b128-fc8380288c83 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-2699c34b-8f48-472c-92cd-686493c5a910-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:51 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Creating direct copy from snapshot {{(pid=82597) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[604720c3-937f-449a-b5cd-16a52f02c78b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:51 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:51 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:51 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f7cb4b-da25-40be-b127-c0495afc35e8]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:52 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.541s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG cinder.utils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Path /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 not found in is_blk_device check {{(pid=82597) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:52 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa Apr 02 20:04:52 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:52 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 Apr 02 20:04:52 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:52 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:52 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:52 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa Apr 02 20:04:52 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:54 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" returned: 0 in 1.400s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa" released by "delete_volume" :: held 1.918s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['ed5185b6-21c8-4e34-958b-ec2ee9c0671c', 'b45dca59-0a89-43e0-8db6-4bdff8f52484', '6aa31373-8c60-4fbf-b467-ab4eae2f632c', '26c06216-f324-4084-935d-a1c2458b1a6c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:54 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:54 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-edd1058f-88c6-4ced-9721-4b4c86eec8be-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-edd1058f-88c6-4ced-9721-4b4c86eec8be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:54 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-edd1058f-88c6-4ced-9721-4b4c86eec8be" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577" returned: 0 in 2.272s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-edd1058f-88c6-4ced-9721-4b4c86eec8be" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bbb22-7756-4d25-a8ee-2e20d45209a1]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b5a62-cfd6-40b2-8c86-72fe550ce59b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:54 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:54 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:54 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:54 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be Apr 02 20:04:54 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:55 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.547s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:55 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-9741e0ff-3e21-47fb-ac53-007af3018ead tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-7eaf0187-0c5a-48a6-97de-5f887f1c4cfa-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:55 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be" returned: 0 in 0.579s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:55 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be Apr 02 20:04:55 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:55 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.649s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.image.image_utils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 {{(pid=82597) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 20:04:55 devstack cinder-volume[82597]: INFO cinder.image.image_utils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Converted 1024.00 MB image at 450.63 MB/s Apr 02 20:04:55 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 is being set with open permissions: ugo+rw Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:55 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 Apr 02 20:04:55 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:55 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-edd1058f-88c6-4ced-9721-4b4c86eec8be" returned: 0 in 0.426s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-edd1058f-88c6-4ced-9721-4b4c86eec8be" released by "delete_volume" :: held 1.058s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['4861c521-57d4-4cdb-8e24-9dcb31750fb8', 'a6314e16-c4b1-4a73-a066-a0a4ed746644', 'ca31cafd-f1cd-4eaa-be4c-733cd79e27f8', '86efdbc8-deb1-44aa-811f-f800be1d7c6c'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:55 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:55 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:55 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577" returned: 0 in 0.499s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" released by "_copy_volume_from_snapshot" :: held 4.552s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-46dd314b-21cc-44ad-91f5-86106235c979" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-46dd314b-21cc-44ad-91f5-86106235c979" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Deleting offline snapshot 46dd314b-21cc-44ad-91f5-86106235c979 of volume 7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] snapshot_file for this snap is: volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66abf2c-9fa6-40f0-978f-4a2283efb99c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:55 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:56 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:56 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:56 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.434s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:56 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b92efc71-c179-40be-b72f-0ec6906280ea tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-edd1058f-88c6-4ced-9721-4b4c86eec8be-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:56 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.477s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6b6a5-e154-4f1d-b559-c7af9923e130]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:56 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:56 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-842f9b8c-7a3f-41ea-860d-fb10d7b462c5-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-842f9b8c-7a3f-41ea-860d-fb10d7b462c5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:56 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.501s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c23de2-a28b-4cc8-9b47-be1ebe305c8f]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:56 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:56 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:56 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:57 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 Apr 02 20:04:57 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:57 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.433s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:57 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979 Apr 02 20:04:57 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:57 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" returned: 0 in 0.508s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:57 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5 Apr 02 20:04:57 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:57 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d.46dd314b-21cc-44ad-91f5-86106235c979" returned: 0 in 0.398s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-46dd314b-21cc-44ad-91f5-86106235c979" released by "_delete_snapshot" :: held 1.862s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.677s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.055s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Creating offline snapshot 29f0d961-135d-44e3-80ca-9570a90627cb of volume 24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d295b90-fe69-4d78-ae94-b30e6049fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577', 'volume_size': 1, 'source_volid': '7c34f847-fa3f-4196-91e0-4b6635fa6e0d', 'source_volstatus': 'available'}' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07811d6-06f8-4e25-ba25-8e42b83b27ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49bce2-3630-461d-aa8c-746f1c5b6a7d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:57 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:57 devstack cinder-volume[82597]: INFO cinder.volume.flows.manager.create_volume [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Volume volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 (5a54887b-f0f2-488c-82f9-d24e2a1e0577): created successfully Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07811d6-06f8-4e25-ba25-8e42b83b27ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82597) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Flow 'volume_create_manager' (cd2b6bbd-04d5-44fe-b0fa-986730bb32c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82597) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" returned: 0 in 0.406s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-842f9b8c-7a3f-41ea-860d-fb10d7b462c5" released by "delete_volume" :: held 0.969s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:57 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-bd2e4b60-e353-4a13-b56c-bef34a5b015d tempest-VolumeDependencyTests-1616403581 None] Created volume successfully. Apr 02 20:04:57 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 Apr 02 20:04:57 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['948bd26c-df82-4671-b10e-f67ac401b613', 'c4060a2d-c662-46c3-a3a7-e23cae84f5b5', 'b3ae86e5-3bae-4657-9654-10735fdd1ecc', 'f281c739-f5ea-42d4-a1fc-dd75eef70d0a'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:57 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:58 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-1afc10fd-db65-4a0b-82eb-6fc1992587cd-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-1afc10fd-db65-4a0b-82eb-6fc1992587cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-1afc10fd-db65-4a0b-82eb-6fc1992587cd" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-1afc10fd-db65-4a0b-82eb-6fc1992587cd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleting offline snapshot 1afc10fd-db65-4a0b-82eb-6fc1992587cd of volume c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] snapshot_file for this snap is: volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[af52cc3d-405e-4a87-8be0-840b77d94f11]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd Apr 02 20:04:58 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-7c34f847-fa3f-4196-91e0-4b6635fa6e0d-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-7c34f847-fa3f-4196-91e0-4b6635fa6e0d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" acquired by "delete_volume" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e49934-835f-4473-a2fc-0e7562f3220c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:58 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86" returned: 0 in 0.491s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb 1G {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb 1G Apr 02 20:04:58 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.545s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:58 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-f3a1f23a-a4f6-4806-82cb-c47cc4d1706b tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-842f9b8c-7a3f-41ea-860d-fb10d7b462c5-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:58 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd" returned: 0 in 0.497s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0af2cdc-4484-488d-914e-77f056e14f28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3095d4d-2cc7-4f7f-8aab-86b729f17b1d]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 Apr 02 20:04:58 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d Apr 02 20:04:58 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:58 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb 1G" returned: 0 in 0.494s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:58 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24131018-8693-4da8-ba3d-329a9da0cb86 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:58 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24131018-8693-4da8-ba3d-329a9da0cb86 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb Apr 02 20:04:58 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28" returned: 0 in 0.466s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd Apr 02 20:04:59 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" returned: 0 in 0.441s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-7c34f847-fa3f-4196-91e0-4b6635fa6e0d" released by "delete_volume" :: held 0.960s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Created reservations ['1fa6a90a-6ca2-4295-a380-26cd9107d0ee', 'f216b245-c9c5-4183-b2ea-c623ce0eaa25', '7c1ccaac-0ec0-478d-a8e8-54a08b3b15ec', 'bde6daed-df32-486d-b4ec-b3da8d24c295'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:04:59 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24131018-8693-4da8-ba3d-329a9da0cb86 -F qcow2 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb" returned: 0 in 0.454s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb is being set with open permissions: ugo+rw Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-5a54887b-f0f2-488c-82f9-d24e2a1e0577-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-5a54887b-f0f2-488c-82f9-d24e2a1e0577-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:59 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb Apr 02 20:04:59 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed564d-9de0-4d55-b96f-2a27ac65514c]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 Apr 02 20:04:59 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd" returned: 0 in 0.520s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd Apr 02 20:04:59 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.446s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:04:59 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Deleted volume successfully. Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-b2bc7c05-f59b-4947-8ecd-a46489ac18f7 tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-7c34f847-fa3f-4196-91e0-4b6635fa6e0d-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:04:59 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb" returned: 0 in 0.484s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info Apr 02 20:04:59 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577" returned: 0 in 0.488s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:04:59 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577 Apr 02 20:04:59 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:04:59 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 02 20:04:59 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28.1afc10fd-db65-4a0b-82eb-6fc1992587cd" returned: 0 in 0.419s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-1afc10fd-db65-4a0b-82eb-6fc1992587cd" released by "_delete_snapshot" :: held 1.961s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" released by "delete_snapshot" :: held 1.972s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['15ecdee6-c384-48ff-bb24-29d828acc709', 'a0e5e782-62dc-4a19-ba18-f4ff9e6e72df', '35c244c9-04be-459c-b5c2-e796397c8136', '4f946684-bbd0-4c83-84fd-cd9264770efe'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Delete snapshot completed successfully. Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-86663f43-895f-4063-a73e-dac96c71dc97 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-1afc10fd-db65-4a0b-82eb-6fc1992587cd-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-c0af2cdc-4484-488d-914e-77f056e14f28-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-c0af2cdc-4484-488d-914e-77f056e14f28-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" acquired by "delete_volume" :: waited 0.006s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41af96-c0f9-4051-9f86-f03db438e1e4]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:00 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: WARNING cinder.volume.drivers.remotefs [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info is being set with open permissions: ugo+rw Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:00 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info Apr 02 20:05:00 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:00 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 Apr 02 20:05:00 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:00 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-5a54887b-f0f2-488c-82f9-d24e2a1e0577" returned: 0 in 0.458s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-5a54887b-f0f2-488c-82f9-d24e2a1e0577" released by "delete_volume" :: held 0.969s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Created reservations ['744b7639-f34a-4a96-8985-f39af3bdc13b', '90a731f3-5a9e-494c-af59-c8b72ace1255', 'b4a13c33-6800-4b07-b04b-18bf5f7d81a9', '0fdeaa6d-8627-46b3-baff-b0c627b2cfbf'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:00 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:00 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-bac70e62-cdf6-4865-8fe9-eaaef8b6421f-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-bac70e62-cdf6-4865-8fe9-eaaef8b6421f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" acquired by "delete_volume" :: waited 0.009s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e22faa5-d363-4131-918b-f4ce7f0e65be]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:00 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f Apr 02 20:05:00 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:00 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.info" returned: 0 in 0.478s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.910s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:00 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28" returned: 0 in 0.524s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-635f1f3c-2aec-4baf-b89e-1caef8e28c2e tempest-CinderUnicodeTest-1914892328 None] Create snapshot completed successfully Apr 02 20:05:00 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28 Apr 02 20:05:00 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:00 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.449s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:00 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Deleted volume successfully. Apr 02 20:05:00 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-c24547bf-42df-4ab5-a558-b74e645f124e tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-5a54887b-f0f2-488c-82f9-d24e2a1e0577-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:01 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" returned: 0 in 0.482s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:01 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f Apr 02 20:05:01 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:01 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-c0af2cdc-4484-488d-914e-77f056e14f28" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-quobyte-c0af2cdc-4484-488d-914e-77f056e14f28" released by "delete_volume" :: held 0.988s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Created reservations ['f750b5fc-6c55-40ee-a112-a14a70d734bf', 'ac07629a-096d-4d2c-ba43-cd31d0b02503', '01c4697a-ba0b-42b2-9470-faf91f276c85', 'e7bdc572-8455-407a-93e6-00facf41c402'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-29f0d961-135d-44e3-80ca-9570a90627cb-delete_snapshot" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-29f0d961-135d-44e3-80ca-9570a90627cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" by "delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:01 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:01 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-quobyte-29f0d961-135d-44e3-80ca-9570a90627cb" by "_delete_snapshot" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-29f0d961-135d-44e3-80ca-9570a90627cb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Deleting offline snapshot 29f0d961-135d-44e3-80ca-9570a90627cb of volume 24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] snapshot_file for this snap is: volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a776171-56ad-4a82-844b-30eb035f046b]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:01 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb Apr 02 20:05:01 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:01 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" returned: 0 in 0.456s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-quobyte-bac70e62-cdf6-4865-8fe9-eaaef8b6421f" released by "delete_volume" :: held 0.958s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Created reservations ['d7550a14-8e7d-4002-ba7b-bba90fb71ac5', 'b71b24c9-b99a-4fcd-8697-7cc893bc7e1d', '735ab719-87cf-41c4-bea0-f37b0f4f3203', '2a93020b-11e0-4d42-914e-c0e8777799be'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:01 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:01 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:01 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.444s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:01 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Deleted volume successfully. Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-669cd399-ad81-4062-9aad-000a1b8d6df3 tempest-CreateVolumesFromSnapshotTest-1551140818 None] Lock "cinder-c0af2cdc-4484-488d-914e-77f056e14f28-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:01 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb" returned: 0 in 0.517s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.remotefs [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24131018-8693-4da8-ba3d-329a9da0cb86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82597) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f587e-6653-4c0b-96a5-cb1e47ec57a7]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:01 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:01 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 Apr 02 20:05:01 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:02 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.475s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:02 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Deleted volume successfully. Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-de37899d-3be4-4ffe-873d-3204ae44524f tempest-VolumeDependencyTests-1616403581 None] Lock "cinder-bac70e62-cdf6-4865-8fe9-eaaef8b6421f-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:02 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86" returned: 0 in 0.554s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:02 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb Apr 02 20:05:02 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:02 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb" returned: 0 in 0.546s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:02 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:02 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb Apr 02 20:05:02 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:03 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:03 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86.29f0d961-135d-44e3-80ca-9570a90627cb" returned: 0 in 0.447s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-29f0d961-135d-44e3-80ca-9570a90627cb" released by "_delete_snapshot" :: held 2.118s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" released by "delete_snapshot" :: held 2.134s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:03 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Created reservations ['5f5254c2-d015-4cc1-b333-28fe83b41110', 'a3025499-30e9-4b6a-8acf-d229717788f2', '2920a286-3c8f-4f90-b28d-feb33eedddf5', '9f935f66-d530-4229-8d75-83fc3bd9f5e0'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:03 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Delete snapshot completed successfully. Apr 02 20:05:03 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-906af65e-a4e1-4704-9b82-a15c5ec0d10a tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-29f0d961-135d-44e3-80ca-9570a90627cb-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-24131018-8693-4da8-ba3d-329a9da0cb86-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-24131018-8693-4da8-ba3d-329a9da0cb86-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" acquired by "delete_volume" :: waited 0.011s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615c1e1-06f8-4c11-9bde-ab3cc72551e6]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:04 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 Apr 02 20:05:04 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:04 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86" returned: 0 in 0.468s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:04 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:04 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86 Apr 02 20:05:04 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:05 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-24131018-8693-4da8-ba3d-329a9da0cb86" returned: 0 in 0.397s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-24131018-8693-4da8-ba3d-329a9da0cb86" released by "delete_volume" :: held 0.896s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Created reservations ['edf844f8-08bb-4f45-a917-720e86fc2a94', '1ffa60ac-56ce-42c4-bc94-82c73c4827f4', '9eb6f996-a709-41dc-b1b8-058d4394cd4a', '1da02614-a7f9-4e4f-aa6e-e9561d7ed746'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:05 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:05 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b-delete_volume" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "cinder-quobyte-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" by "delete_volume" {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" acquired by "delete_volume" :: waited 0.007s {{(pid=82597) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8bd26e-9e67-44d8-aa34-d6e5c931c016]: (4, 'qcow2') {{(pid=83318) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:05 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b Apr 02 20:05:05 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:05 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.436s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:05 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Deleted volume successfully. Apr 02 20:05:05 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-55743232-75f3-40b9-9cff-acba6c573fbe tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-24131018-8693-4da8-ba3d-329a9da0cb86-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:06 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" returned: 0 in 0.473s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:06 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b Apr 02 20:05:06 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:06 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92/volume-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" returned: 0 in 0.387s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-quobyte-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b" released by "delete_volume" :: held 0.893s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.quota [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Created reservations ['371e5707-531f-4732-a0fd-aaefa30dfc31', 'ae1388d3-bece-41f8-b0d7-efff09c6f45a', 'c5af4dea-35fb-4ec9-81c6-820855a9f01e', '5781b480-628a-43ec-a1de-1dc5d1a1f985'] {{(pid=82597) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:06 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:06 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_service.periodic_task [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82597) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b': None} {{(pid=82597) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.volume.drivers.quobyte [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6d94881f-f81d-48fd-985c-221e400cea4b'] {{(pid=82597) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.lockutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82597) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 20:05:06 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92 Apr 02 20:05:06 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 20:05:06 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.424s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:06 devstack cinder-volume[82597]: INFO cinder.volume.manager [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Deleted volume successfully. Apr 02 20:05:06 devstack cinder-volume[82597]: DEBUG cinder.coordination [None req-ad3600c4-e45d-42ab-ac48-250d7dcf2a01 tempest-CinderUnicodeTest-1914892328 None] Lock "cinder-0cfe6f98-c4f6-4000-a65b-ffda2cdf399b-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82597) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 20:05:07 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 02 20:05:07 devstack cinder-volume[82597]: DEBUG oslo_concurrency.processutils [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5d21b305f25886aafc3b0b1d4defe92" returned: 0 in 0.462s {{(pid=82597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 20:05:07 devstack cinder-volume[82597]: DEBUG cinder.manager [None req-02971f42-b52d-49da-89ff-43e581f353f0 None None] Notifying Schedulers of capabilities ... {{(pid=82597) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 20:05:16 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=195,cinder:SELECT=148,cinder:INSERT=68,cinder:DELETE=16 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 20:05:16 devstack cinder-volume[82597]: DEBUG dbcounter [-] [82597] Writing DB stats cinder:UPDATE=216,cinder:SELECT=148,cinder:INSERT=35,cinder:DELETE=17 {{(pid=82597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}